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Most  preemptive  priority  queueing  models  in  the 
literature  assume  that  jobs  arrive  from  populations  with 
infinite  size.  This  dissertation  studies  preemptive  priority 
queueing  models  where  jobs  arrive  from  populations  of  size 
one.  The  models  are  motivated  by  a number  of  applications, 
most  notably  the  control  architecture  of  an  embedded, 
interrupt— driven  microcontroller.  Moreover,  the  performance 
measures  of  interest  in  these  applications  differ  from  the 

measures  used  in  traditional  preemptive  priority  queueing 
models . 
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CHAPTER  1 
INTRODUCTION 

Motivation  and  Applications 

The  problem  under  study  stems  from  the  desire  to 
implement  a (micro) processor  architecture  that  will  handle 
interrupts,  or  service  calls,  from  many  possible  sources  and 
control  a system  in  a real-time  manner.  Such  a system  will 
respond  to  events  or  states  rather  than  checking  conditions 
sequentially,  which  is  often  referred  to  as  polling. 

The  architecture  may  employ  two  processors  that  share  the 
task  of  controlling  the  system:  one  processor  handles  the 
procedural  tasks,  and  the  other  processor  handles  intelligent 
nonsequential  logic.  This  system  model  is  motivated  by  the 
way  human  operators  approach  control  tasks. 

The  processor  can  be  described  as  a server  for  jobs  that 
are  queued  up  for  processing.  These  jobs  are  procedures  of 
computer  programs  that  may  be  either  sequential  steps,  such  as 
arithmetic  operations,  or  decision-making  steps,  such  as 
iopical  comparisons,  that  may  result  in  branching  to  a 
different  section  of  the  program.  There  also  may  be  different 
types  of  branching:  those  that  require  the  program  to  return 
to  the  code  it  was  processing  initially,  referred  to  as  calls. 
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and  those  that  do  not  require  the  program  to  return,  referred 
to  as  jumps . 

In  order  for  the  processor  to  perform  the  required 
program  steps,  each  of  these  steps  must  be  translated  into 
machine  instructions.  These  machine  instructions  are  further 
broken  into  bit  manipulations,  which  are  carried  out  by  the 
processor.  Thus,  one  step  in  a particular  program  code  may 
result  in  hundreds  of  bit  manipulations;  for  example,  in  the 
case  of  a call,  the  processor  must  first  save  the  address  of 
the  next  operation  and,  optionally,  some  or  all  of  its  status 
flags  and  then  find  the  address  to  which  it  should  branch. 
After  performing  those  instructions,  it  must  then  return  to 
the  address  of  the  previous  sequential  instruction  that  it 
saved  and  restore  the  status  flags  before  continuing 
processing.  In  the  case  of  a process  control  program  where 
there  are  many  inputs  to  the  controller  from  external  devices, 
the  processor  could  branch  and  return  many  times  according  to 
different  conditions  before  completing  any  particular  task. 

For  instance,  if  an  autonomous  guided  vehicle  (AGV) 
receives  a signal  for  a special  load  of  subassemblies  from 
storage  (task  2)  while  performing  routine  transportation  of 
parts  from  station  to  station  in  a factory  (task  3) , task  2 
may  preempt  task  3.  In  addition,  while  performing  task  2,  if 
someone  steps  in  front  of  the  AGV,  this  special  condition 
triggers  task  1,  a high-priority  task  of  applying  and  holding 
the  brakes  until  the  path  is  clear.  According  to  how  long 
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task  1 takes,  the  situation  may  arise  that  task  3 becomes  more 
important  than  task  2 if  some  workstations  are  shutting  down 
due  to  the  lack  of  parts  (an  example  of  priority  swapping)  ; 

thus,  task  3 will  resume  until  its  priority  drops  lower  than 
that  of  task  2. 

Another  application  is  that  of  a nurse  in  an  intensive 
care  unit  (ICU)  . In  the  ICU,  there  are  usually  a limited 
number  of  beds  with  each  patient  at  different  stages  of 
recovery.  The  nurse  usually  has  normal  daily  work  to  perform. 
In  the  case  of  one  of  the  patients  needing  attention,  the 
patient's  care  takes  priority  over  normal  "daily"  tasks.  In 
the  case  where  there  is  more  than  one  patient  needing 
attention,  depending  on  their  status  and  the  urgency  of  their 
requests,  task  priorities  are  assigned  by  the  nurse,  often 
mentally  in  real  time.  A queue  of  waiting  priority-indexed 
requests  that  have  the  ability  to  preempt  lower  priority 
requests  is  formed.  This  example  also  highlights  the  case  of 
having  only  one  job  of  each  priority  class;  each  patient  has 
only  one  beeper,  so  when  it  is  activated  to  request  attention 
it  cannot  be  activated  again  until  the  nurse  answers  the 
request.  This  can  be  contrasted  with  a clinical  setting,  such 
as  the  emergency  room  where  a doctor  may  have  an  increasing 
number  of  requests,  some  of  similar  priority,  some  arriving  in 
batch,  and  only  very  few  having  the  ability  to  preempt  other 
requests  to  get  the  doctor's  attention. 
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There  are  other  examples  in  the  literature  of  preemptive 
priority  systems.  However,  our  applications  all  have  the 
distinguishing  feature  of  priority  classes  of  size  one. 

Introduction 

This  work  focusses  on  a preemptive  priority  queueing 
system  with  one  server  working  at  a constant  rate.  The  unique 
characteristic  of  the  system  considered  is  that  of  a finite 
number  of  priority  classes  with  only  one  job  per  priority 
class.  This  is  motivated  by  the  supervisory  systems  to  which 
this  work  will  be  applied.  The  interarrival  times  are  assumed 
to  be  identically  and  independently  distributed  with  a 
negative  exponential  distribution.  Many  different  service- 
time distributions  are  considered:  general,  deterministic, 
exponential,  and  uniform.  The  study  of  the  analytical  models 
yields  performance  measures  which  are  useful  in  analyzing  and 
designing  applications. 

For  the  purposes  of  this  work,  the  system' s state— space 
is  defined  by  the  remaining  service  time  required  by  each  job. 
The  jobs  that  define  the  state-space  may  either  be  in  service 
or  in  the  queue.  Remember,  the  queue  may  contain  both  jobs 
that  have  not  yet  been  serviced  and  those  that  have  been 
partially  serviced  and  preempted.  The  probability  of  the 
system  being  in  a particular  state  ( r^ , r2,  r^ . . . , r^)  with  each 
of  n jobs  having  s^  service  time  remaining  is  given  by 
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Prob  ( s^— Ti , S2=r2/ S3=r3  . . . ^ , where  is  the  remaining 
service  time  for  job  i. 

Since  there  is  the  special  model  property  of  only  one  job 
per  priority  class  in  this  system,  it  is  known  that  if  S|>0, 
then  no  more  jobs  of  priority  class  i can  join  the  system; 
similarly,  if  Sj^=0,  after  the  passage  of  an  interarrival 
period,  a job  of  priority  class  i is  expected  to  join  the 

queue,  or  preempt  the  currently  serviced  job  if  its  priority 
is  less  than  i. 

In  order  to  make  the  notation  easier  to  follow,  a job  of 
priority  j will  be  referred  to  as  a j-job.  This  follows  the 
notation  used  by  Wolff  [1]. 

This  dissertation  is  arranged  in  four  main  parts. 
Firstly,  we  introduce  the  general  terminology  and  performance 
measures  that  is  used  in  the  queueing  models;  secondly,  we 
will  discuss  the  new  work  that  this  dissertation  will  add  to 
the  existing  body  of  queueing  literature;  thirdly,  we  review 
pertinent  past  work;  then,  starting  with  Chapter  2,  we  present 
the  models  and  subsequent  analysis  which  constitute  the  main 
contribution  of  this  dissertation. 

Queueing  Terminology 

In  general,  a queueing  system  consists  of  an  arrival 
process,  a buffer  or  queue,  and  a service  process.  Figure  1.1 
shows  a diagram  of  a general  queueing  system. 
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The  arrival  process  introduces  jobs  or  customers  into  the 
queue  and  is  described  by  its  population  size,  or  the  number 
of  jobs  it  can  introduce  into  the  system  (finite  or  infinite) , 
and  the  nature  of  the  jobs  it  generates.  The  arrival  process 
also  specifies  the  probability  law  of  the  interarrival  times. 
When  a new  job  is  introduced  to  the  queue,  there  are  rules 
that  determine  which  position  in  the  queue  the  job  should 
occupy.  If  all  of  the  jobs  are  of  the  same  priority  level, 
then  it  is  generally  accepted  that  new  jobs  occupy  the  first 
open  position  at  the  end  of  the  queue.  If  there  are  varying 


priorities,  that  is,  one  job  or  class  of  jobs  is  deemed  more 
urgent  than  other  classes  of  jobs,  then  the  new  job  occupies 

the  position  in  the  queue  directly  following  the  last  job  of 
its  class. 


After  the  jobs  have  been  arranged  in  the  queue,  it  must 
be  decided  which  job  should  be  processed.  One  of  the  simplest 
rules,  or  queue  disciplines,  is  the  f irst~come~f irst~served 
discipline.  This  rule  states  that  the  next  job  to  be  served 
is  the  one  that  has  been  in  the  queue  the  longest . Since,  as 
mentioned  earlier,  the  queues  grow  from  the  back,  the  chosen 
job  is  normally  the  job  in  the  first  position  or  the  front  of 
the  queue.  In  the  case  of  priorities,  this  discipline  is 
rtiodified  to  state,  of  the  jobs  with  the  highest  priority 
present,  the  one  that  has  been  waiting  in  the  queue  the 
longest  is  served  next.  Of  course,  if  the  job  with  higher 
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priority  is  placed  toward  the  front  of  the  queue,  this  will 
again  be  the  job  at  the  front  of  the  queue. 

There  are  many  other  queue  disciplines  that  will  not  be 
discussed  here  but  are  easily  found  in  most  introductory 
queueing  texts  [4].  Most  of  these  allow  the  job  being 
serviced  to  complete  its  service  before  the  next  job  starts 
service.  For  example,  head-of-the-line  priority  allows  jobs 
to  jump  to  the  front  of  the  queue  if  they  have  the  highest 
priority.  They  are  then  served  in  advance  of  other  jobs, 
which  may  have  been  there  before  the  arrival,  after  the  server 
completes  its  current  task.  This  is  sometimes  referred  to  as 
nonpreemptive  priority  service  discipline.  One  class  of 
queueing  disciplines  that  is  contrary  to  this  principle  is  the 
preemptive  priority  disciplines. 

With  preemption,  the  arriving  high  priority  job  has  the 
S-bility  to  cause  the  server  to  stop  processing  (or  preempt) 
any  job  that  has  a lower  priority,  send  that  preempted  job 
back  to  the  queue,  and  start  processing  the  high  priority  job. 
Priority  1 is  normally  considered  the  highest  priority. 
Figure  1.2  shows  a diagrami  of  a queueing  system  with 
preemption . 

When  the  server  has  finished  processing  the  high  priority 
job,  it  takes  the  job  with  the  highest  priority  from  the 
queue.  Eventually,  the  job  that  was  preempted  may  restart  its 
service.  At  this  point  there  is  some  service  discipline  which 
specifies  how  that  preempted  job  is  restarted.  These 
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disciplines  may  be  preemptive-resume,  or  preempt ive— repeat . 
In  preemptive-resume,  the  preempted  task  is  continued  from  the 
point  where  processing  on  it  stopped;  however,  in  the 
preemptive-repeat  discipline,  service  on  the  preempted  task 
must  be  restarted;  thus,  all  work  done  on  the  preempted  task 
before  its  preemption  is  lost.  There  are  two  alternatives  in 
the  preemptive-repeat  discipline,  repeat-identical  and  repeat- 
different.  The  repeat-identical  allows  the  preempted  job  to 
be  repeated  with  the  required  service  being  the  same  as  that 
specified  when  service  on  it  was  started  previously;  whereas 
the  repeat-different  allows  the  generation  of  a new  value  of 
the  required  service  time  when  that  preempted  job  is 
restarted . 

As  alluded  to  above,  the  service  time  of  a job  is 
dependent  on  the  service  requirement  of  the  job.  In  addition 
to  this,  the  service  time  is  also  dependent  on  the  service 
rate  of  the  server.  There  are  some  differences  between  models 
when  the  service  rate  is  constant  and  the  service  requirement 
is  variable,  and  when  the  service  rate  is  variable  and  the 
service  requirement  is  fixed  [5,6]. 

The  service  process  consists  of  one  or  more  servers 
arranged  sequentially,  in  parallel,  or  in  some  network 
configuration.  Each  configuration  needs  specific  rules  for 
deciding  how  and  when  each  server  is  activated. 

When  the  job  has  finished  service,  it  must  be  decided  if 
it  is  to  return  to  the  job  pool  where  it  may  be  activated  and 


9 


reintroduced  into  the  queue  at  some  later  time.  In  the  case 
of  o finite  job  pool,  this  decision  is  an  important  one  and  is 
normally  dependent  on  the  system  that  is  being  modelled.  The 
time  period  between  the  job  reentering  the  pool  and  its  being 
reactivated  is  called  the  reactivation  time  of  the  jobs.  This 
may  be  different  from  the  interarrival  time,  which  is  the  time 
period  between  sequential  arrivals  of  jobs. 


New  Work 

There  exists  a wide  range  of  theoretical  and  application- 
oriented  work  in  queueing  theory  for  the  modelling  and 
analysis  of  stochastic  systems.  However,  of  such  works,  few 
address  the  modelling  of  systems  with  priorities  and 
preemptive-resume  disciplines. 

Stochastic  systems  with  priorities  and  preemptive-resume 
disciplines  occur  in  everyday  life,  especially  in  situations 
of  supervisory  control . One  such  system  is  the  use  of  a human 
operator  to  monitor  a control  panel . Such  a panel  may  contain 
displays  that  track  processes  or  that  may  result  in  conditions 
that  require  certain  actions.  Another  similar  system  involves 
the  use  of  a microprocessor  as  a monitor  to  sense  certain 
conditions  and  trigger  appropriate  actions  in  response  to 
those  conditions.  Other  examples  vary  from  parallel  waiting 
lines  with  different  priorities  [2]  to  machines  subject  to 
breakdown  [ 3 ] . 
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As  mentioned  previously,  this  dissertation  looks  at 
systems  which  have  populations  only  of  size  one.  Figure  1.3 
and  1.4  show  how  the  limited-sized  populations  affect  the 
observed  arrival  rate  at  the  server' s queue  (the  virtual 
arrival  rate) . We  will  assume  exponential  distributions  for 
the  interarrival  times  and  the  service  time  with  expected 
values  of  1/X^  and  l/oc^  respectively.  For  this  work,  there  is 
only  one  server  that  works  at  a fixed  rate.  Therefore,  the 
service  time  of  each  job  depends  on  the  service  requirement  of 
the  job  itself. 

As  shown  in  Figure  1.3,  in  the  case  of  unlimited 
population  sizes,  the  j-job's  arrival  process  restarts  when 
the  previous  j-job  is  introduced  into  the  queue.  However,  as 
seen  in  Figure  1.4,  if  the  population  size  is  limited  to  one, 
^ j“ job' s presence  in  the  system  excludes  the  possibility  of 
another  j~job  arriving;  thus  the  arrival  process  restarts  only 
after  the  j-job  has  completed  it  service  and  is  released  from 
the  server.  Therefore,  if  the  population  size  is  limited  to 
one,  the  virtual  ' interarrival  time  of  the  j-job  is  actually 
dictated  by  the  cycle  time  rather  than  by  only  the  arrival 
process  as  in  the  case  of  unlimited  population  size.  The 
representative  system  that  will  be  modelled  and  analyzed  is 
based  on  a microprocessor  driven  by  interrupts.  Each  of  these 
interrupts  has  a different  priority  and  can  only  be  activated 
(or  fired)  once;  it  must  then  wait  until  it  is  served  before 
it  can  be  fired  again. 
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Thus,  a given  job  is,  at  any  given  time,  in  one  of  four 
states:  1)  idle,  waiting  to  be  introduced  into  the  queue,  2) 
in  the  queue,  but  never  processed,  3)  partially  processed,  but 
preempted  and  waiting  in  the  queue  to  complete  service,  or  4) 
being  processed.  Only  the  highest  priority  job  has  less  than 
these  four  possible  states  since  it  can  never  be  preempted  or 
is  never  in  initial  waiting. 

This  dissertation  will  present  work  on  models  relating  to 
three  preemptive-resume  systems.  The  first  is  the  basic 
preempt ive— resume  system  which  have  been  discussed  previously. 
Figure  1.5  shows  a diagram  of  this  system. 

The  second  system  is  a preemptive-resume  system  with 
resume  penalties.  Applications  of  this  system  include  systems 
with  machine  setup  costs  or  human  monitoring  systems  which 
need  the  allowance  of  reorganization  time  before  resuming  a 
preempted  job.  These  systems  are  intermediate  to  preemptive- 
repeat  and  preemptive-resume  and  could  possibly  be  modelled  as 
a special  class  of  a preemptive-repeat-different  system.  A 
diagram  for  this  system  is  shown  in  Figure  1.6. 

The  third  system  is  a preemptive-resume  system  which 
allows  the  priorities  of  the  jobs  to  switch  whenever  a new  job 
arrives  to  the  queue.  Figure  1.7  shows  a diagram  of  this 
system.  As  shown  a added  parameter  p^^,  the  probability  that 
the  i-job  is  assigned  priority  j when  it  arrived  to  the  queue, 
is  added  to  the  arrival  process  description.  These  are 
apriori  probability  masses  assigned  to  each  job. 
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In  order  to  simplify  the  description  of  the  different 
model  we  will  be  analyzing,  a six  part  descriptor,  similar  to 
those  used  previously  [3],  will  be  used  for  the  different 
models  of  the  three  systems.  A/B/m/K/P/Mi , . . . , Mp : A and  B 
represent  the  interarrival  time  distribution  and  service  time 
distribution  respectively,  m is  the  number  of  servers,  K is 
the  system's  storage  capacity  (that  is,  the  maximum  allowed 
queue  size)  , P is  the  number  of  priority  classes,  and  M^,  . . . , Mp 

are  the  sizes  of  the  customer  population  for  each  of  the 
priority  classes. 

Normally  considered  for  A and  B are  five  symbols  (whose 
distributions  are  given  in  parentheses):  M (exponential),  Er 
(^“Stage  Erlangian) , HR  (R-stage  hyperexponential) , D 
(deterministic) , G (general) . One  additional  symbol  that  will 
be  used  is  U for  the  uniform  distribution.  Notice  that  this 
descriptor  introduces  the  number  of  priority  classes  P and 
M^s,  population  sizes  of  priority  classes,  as  symbols 
additional  to  those  normally  used. 

Our  problem  has  additional  structure  in  that  all  of  the 
M^s  are  equal  to  one.  This  means,  at  most  one  job  of  a 
particular  class  can  be  in  the  system  at  any  particular  time. 
This  special  structure  will  be  represented  by  placing  only  one 
1 in  the  place  of  the  M^s,  A/B/m/K/P/1. 

In  Chapter  2,  we  will  look  at  models  of  the  basic  system 
with  the  assumption  that  the  service  times  are  discrete 
increments.  The  models  that  will  be  addressed  are: 
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M/G/1/2/2/1  and 
M/D/1/2/2/1 . 

Then  in  Chapters  3 and  4,  we  will  look  at  the  same  basic 
model  but  with  continuous  service  time  state-space.  Chapter 
3 will  discuss  models  with  the  following  unbounded  service 
time  distributions: 

M/C/1/2/2/1,  M/C/1/3/3/1,  M/C/l/n/n/1  and 
M/M/1/2/2/1,  M/M/1/3/3/1,  M/M/l/n/n/1. 

Chapter  4 will  discuss  models  with  the  following  bounded 
service  time  distributions: 

M/D/1/2/2/1,  M/D/1/3/3/1,  M/D/l/n/n/1  and 
M/U/1/2/2/1,  M/U/1/3/3/1. 

In  addition  to  the  models  analyzed,  the  approaches  used 
to  analyze  these  models  add  to  the  uniqueness  of  this  work. 
These  approaches  are  discussed  in  a later  section. 

Performance  Measures 

One  of  the  main  focus  of  this  work  is  to  address  the 
performance  issues  of  a preemptive  priority  queueing  system 
with  many  priority  classes,  each  of  size  one.  As  mentioned 
earlier,  any  job  may  be  in  one  of  four  states: 

1.  waiting  in  the  queue  having  never  started  service. 

2 . preempted  and  waiting  in  the  queue  to  return  to 
service 


3.  being  serviced 
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4 .  completed  service  and  waiting  to  be  reintroduced  into 
the  queue 

Some  performance  measures  and  random  variables  of 
interest  are  first  listed  below  and  then  explained. 

1.  the  initial  waiting  time  of  a j-job, 

2.  the  in-process  waiting  time  of  a j-job, 

3.  the  virtual  service  time  of  a j-job, 

4 . the  completion  time  of  a j-job, 

5.  the  expected  cycle  time  of  a j-job, 

6.  the  virtual  arrival  rate  of  a j-job, 

7 . the  maximum  loading  of  such  a system, 

8 . server  speed, 

9.  job  selection  or  grouping,  and 

10.  job  prioritizing. 


The  initial  waiting  period  is  when  the  job  is  waiting  in 
the  queue  without  ever  having  started  service.  This  occurs 

when  a low  priority  job  arrives  during  the  service  of  a higher 
priority  job. 

The  in-process  waiting  time  is  the  sum  of  all  the  time 

periods  during  which  a job  is  preempted  and  waiting  to  be 
served . 

Jaiswal  [7]  defines  the  completion  time  as  that  period 
which  begins  from  the  instant  the  service  of  a job  starts,  and 
ends  at  the  instant  the  server  becomes  free  to  take  the  next 
job  of  that  class.  Keilson  [8]  calls  this  the  basic  server 
sojourn  time  whereas  Avi— Itzhak  and  Naor  [9]  calls  this  the 
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residence  time.  We  will  refer  to  this  period  as  the  virtual 
service  time.  Except  for  the  highest  priority  job,  this  will 
not  necessarily  be  the  same  as  the  actual  service  time  since 
a job  may  be  preempted. 

Our  definition  of  the  completion  time  will  be  that  period 
which  begins  the  instant  a job  enters  the  queue  for  the  first 
time  and  ends  at  the  instant  the  server  becomes  free  to  take 
the  next  job  of  that  class. 

The  cycle  time  of  a j-job  is  its  initial  waiting  time 
added  to  its  completion  time.  The  inverse  of  the  expected 
cycle  time  gives  a measure  of  the  arrival  rate  of  the  j-jobs 
which  is  called  the  virtual  arrival  rate. 

The  virtual  arrival  rate  of  a job  of  a particular 
priority  class  is  defined  as  the  rate  of  arrival  which  is 
observed  at  the  queue.  ' For  models'  with  infinite  population 
sizes,  the  virtual  arrival  rate  is  equal  to  the  actual  arrival 
rate.  However,  for  models  with  finite  populations,  when  all 
of  the  jobs  in  a particular  priority  class  are  in  the  queue, 
the  arrivals  for  that  class  stop  so  the  long-term  arrival  rate 
observed  at  the  queue  is  less  than  the  actual  arrival  rate. 
Since  our  model  has  only  one  job  in  each  class,  this  effect 
can  be  especially  pronounced.  The  virtual  arrival  rate  is 
always  less  than  the  rate  defined  by  the  interarrival  process 
which  releases  the  job  into  the  queue.  This  special  structure 
of  this  system's  environment,  where  at  most  one  job  of  a 
Particular  priority  class  is  present  for  any  particular  state. 
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means  that  a job  of  a particular  priority  class  cannot  be 
introduced  until  the  existing  job  of  the  same  class  is 
completed.  The  virtual  arrival  rate  will  thus  depend,  in 
part,  on  its  completion  time. 

The  "maximum  loading"  will  refer  to  the  maximum  number  of 
jobs  that  can  be  serviced  by  the  server  while  it  maintains  a 
predetermined  probability  of  being  idle.  Let  us  define  the 
delay  factor  of  a j-job,  d‘^’,  to  be  the  ratio  of  the  sum  of 
the  expected  initial  waiting  time  and  the  expected  in— process 
waiting  time  to  the  expected  service  time.  This  ratio  gives 
a measure  of  the  proportion  of  the  service  time  that  the  j-job 
spends  waiting  to  either  start  service  or  during  preemption. 

This  measure  will  range  from  zero  to  infinity.  The  value 
for  the  highest  priority  job  d*^*  will  always  be  zero  since  it 
never  waits  for  service.  However,  our  concern  is  with  the 
lower  priority  jobs,  say  an  n-job.  The  value  of  d‘"’  is  close 
to  0 when  the  traffic  intensity  for  the  higher  priority  jobs 
is  low;  as  the  traffic  intensity  increases,  as  shown  later, 
d‘"’  increases  rapidly. 

Since  it  is  clearly  impractical  to  define  d‘"’  for  all 
combinations  of  values  of  arrival  rate  for  the  n different 
jobs,  we  will  define  the  maximum  loading  of  the  system, 
NL(d‘"’),  to  be  the  maximum  value  of  n such  that  some 
performance  measure  is  less  than  a prespecified  quantity, 
given  that  all  arrival  rates  and  service  time  distributions 
are  prespecified.  Since  the  expected  initial  waiting  time  and 
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the  in-process  waiting  time  are  the  measures  that  designers 
may  want  to  minimize,  the  maximum  loading  may  be  specified  for 
an  upper  limit  of  either  of  these  performance  measures. 

The  expected  initial  waiting  time  will  be  of  more 
importance  for  jobs  that  need  to  begin  service  as  soon  as 
possible.  An  example  of  this  may  be  telephone  calls  coming 
into  a switchboard.  It  is  important  for  the  operator  to 
answer  these  calls  as  fast  as  possible,  even  if  the  calls  are 
subsequently  put  on  hold  while  the  previous  calls  are 
completed.  If  the  calls  are  not  answered  fast,  they  will 
probably  hang  up;  this  is  called  balking. 

Both  the  expected  initial  waiting  time  and  the  expected 
in-process  waiting  time  are  important  for  jobs  that  cannot  be 
left  idle  for  too  long.  For  example,  if  phone  calls  are  kept 
on  hold  for  tod  long,"  they  will  renege,  or  hang  up.-  This 
concern  is  also  valid  in  the  manufacturing  of  unstable 
chemical  compounds  or  in  the  processing  of  food  and  perishable 
products . 

In  order  to  represent  properly  the  effect  of  waiting 
time,  the  expected  value  of  the  service  time  must  be 
considered.  That  is,  if  the  expected  service  time  is  large, 
a small  waiting  time  will  not  be  as  detrimental  as  if  the 
expected  service  time  is  small.  Thus,  the  loading  factor  is 
a more  accurate  performance  measure  than  the  expected  values 
of  the  waiting  times. 
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In  order  to  increase  loading,  the  server  speed  can  be 
specified  that  will  allow  the  loading  to  be  minimized.  Jobs 
can  be  grouped  or  prioritized  in  order  to  load  different 
servers  at  different  levels. 

These  performance  measures  are  illustrated  in  Figure  1.8, 
given  that  job  i is  introduced  to  the  queue  for  the  first  time 
at  time  A,  starts  service  at  time  B after  waiting  in  the 
queue,  and  completes  service  at  time  C. 

From  Figure  1.8,  it  can  be  seen  that  we  can  define  the 
four  states  (not  mutually  exclusive)  for  a j— job:  the  initial 
waiting  state,  where  the  j-job  has  arrived  but  has  never 

started  service;  the  in-process  waiting  state,  W‘^’,  where  the 
j-job  is  preempted;  the  virtual  service  time  state, 
where  the  j-job  is  either  being  served  or  is  preempted;  and 
the  completion  state,  where  the  j-job  is  either  in  the 

virtual  service  time  state  or  in  the  initial  waiting  state. 

The  time  spent  in  each  of  these  states  can  be  formulated  as 
follows : 


In-Process  Waiting  Time 


Virtual  Service  Time 


Initial  Waiting  Time 


T, 


Virtual  Completion  Time 


Cycle  Time 


T^,„+  1/P<J> 
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Virtual  Arrival 


Delay  Factor 


Rate  (or  Probability)  = - l/y‘^> 

_ ( j ) _ ^ ^ 

E [ T^,„  ] 


Notice  that  the  initial  waiting  period  is  zero  if  the  job 
arrives  while  the  server  is  idle.  All  of  these  performance 
measures  will  be  evaluated  from  the  steady-state  behavior  of 
the  system. 


Related  Past  Work 

While  there  exists  a large  volume  of  work  on  general 
gueueing  theory  and  its  applications,  very  little  work  has 

been  done  relating  to  priority  queues  with  preemption 
disciplines . 

Many  papers  dealing  with  the  theory  and  application  of 
priority  queues  study  the  case  of  head-of-the-line  priority. 
Cobham  [10]  introduces  this  problem  and  presents  results  for 
the  average  elapsed  time  between  the  arrival  in  the  line  of 
a job  of  a given  priority  and  its  beginning  service.  Holley 
[2]  extends  this  work  by  giving  a simplified  approach  to 
obtaining  the  results  presented  by  Cobham  [10,11]  and  applies 
it  to  the  case  of  one  priority  class.  Phipps  [3]  develops 
similar  results  for  the  case  where  the  priority— labelling 
index  is  continuous  rather  than  discrete.  Those  results  are 
then  applied  to  a machine-repair  problem.  More  results 
related  to  this  head-of-the-line  priority  model  are  presented 
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by  Dressin  [12],  Jaiswal  [13],  Williams  [14],  Baba  [15],  and 
Jeya-Chandra  [16] . 

Barry  [17]  is  one  of  the  first  researchers  to  define  a 
queueing  model  that  uses  preemptive  priorities.  His  model 
involves  two  priority  classes,  each  with  infinite  populations. 
Results  given  include  the  generating  function  of  the 
probability  that  m priority-two  jobs  and  n priority-one  jobs 
are  present,  the  probability  that  n priority-one  jobs  are  in 
the  queue,  and  the  expected  number  • of  priority-one  and 
priority-two  jobs  in  the  queue. 

White  and  Christie  [18]  and  Stephan  [19]  also  present 
some  of  the  initial  work  on  preemptive  priority  queues.  White 
and  Christie  [18]  use  a differential-difference  equation 
approach  to  find  the  waiting-line-length  state  probabilities 
for  a model  with  two  priorities  classes  each  with  infinite 
populations.  Stephan  [19]  discusses  a model  where  two  queues 
and  a single  server  exist,  and  priority  is  given  to  jobs  from 
one  queue . 

White  and  Christie  [20]  show  the  similarity  between 
preemptive  priority  models  and  breakdown  models.  Breakdown 
models  are  those  in  which  the  server  becomes  inoperative  for 
a period  of  time  (the  arrival  of  a breakdown)  and  then  returns 
to  processing  the  appropriate  job.  They  provide  steady-state 
solutions  for  the  single  server  case  with  Poisson  arrivals  and 
negative  exponential  service  times  for  each  priority  class. 
They  develop  a formula  for  the  joint  probability  distribution 
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of  queue  lengths  of  two  preemptive  priority  classes,  with 
moments  of  this  queue  length  found  by  the  generating  function 
approach.  They  also  find,  for  any  number  of  preemptive 
priority  classes,  the  expected  time  in  the  system  for  each 
class  for  general  service  time  distribution;  the  generating 
functions  for  the  delay  distribution  are  also  obtained.  All 
population  sizes  are  assumed  to  be  infinite. 

Stephan  [21]  analyzes  two  queues  under  preemptive 
priority  with  Poisson  arrival  and  service  times.  This  is  an 
extension  of  the  work  done  by  White  and  Christie  [20]  using 
the  random  walk  approach  to  get  recursive  relations  between 
state  probabilities  in  the  steady  state.  Two  main  results  of 
this  work  are  the  moments  of  the  length  of  the  lower  priority 
queue  and  the  moments  of  the  waiting  times  for  elements  of  the 
lower  priority  class  that  arrive  when  the  system  is  in  a given 
state.  The  moments  of  the  waiting  time  and  the  time  in  the 
system  are  also  obtained  recursively  for  the  steady  state. 

Morse  [22]  discusses  the  effects  of  preemptive  priorities 
on  the  mean  wait-in-queue  and  the  average  delay  of  both  high 
and  low  priority  jobs  for  a model  with  two  priority  classes, 
each  with  infinite  population  sizes. 

Gaver  [23]  introduces  an  imbedded  Markov  chain  approach, 
which  he  uses  to  study  the  waiting-line  process  of  simple 
queues  without  priorities. 

Miller  [24]  provides  results  for  a preemptive  priority 
model  with  K priority  classes,  each  with  infinite  populations. 
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The  results  presented  are  the  generating  function  for  the 
stationary  probabilities  rn  the  number  of  priority  and  non- 
priority  jobs,  the  Laplace-Stielt jes  transforms  of  the  waiting 
time  distributions,  the  Laplace-Stielt jes  transform  of  the 
distribution  of  a busy  period,  and  the  generating  function  for 
the  probabilities  on  the  number  of  items  serviced  during  a 
busy  period. 

Heathcote  [25]  uses  the  method  of  generating  functions  to 
solve  for  the  moments  of  the  distribution  of  the  nonpriority 
queue  length  and  the  distribution  of  the  busy  period  for  the 
nonpriority  queue  for  a two-dimensional  preemptive  priority 
queueing  problem. 

Avi  — Itzhak  and  Naor  [26]  find  the  expected  value  and 
variance  of  the  performance  measures  of  the  queue  of  ordinary 
customers  for  a single  server  two-priority  class  system.  The 
arrivals  are  Poisson  distributed,  and  the  service  times  are 
exponentially  distributed.  An  application  of  such  a system  to 
the  analysis  of  a human  operator  in  a supervisory  role  is 
described.  This  work  builds  directly  on  the  work  done  by 
Stephan  [21]. 

Jaiswal  [27]  presents  the  queue  length  probability 
generating  function  for  a preemptive  resume  priority  queue  by 
using  the  supplemental  variable  method.  The  Laplace  transform 
of  the  time  dependent  probability  generating  function  and  the 
length  of  the  busy  periods  are  also  presented. 
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Gaver  [28]  studies  a single  server  system  with  Poiss 


on 


inputs  and  general  independent  service  times.  This  system  is 
subject  to  random  interruptions  with  independent  but  otherwise 
arbitrarily  distributed  durations.  The  distributions  of  the 
busy  period  distribution,  queue  length,  and  waiting  times  are 
developed  from  their  transforms  and  moments.  These  results 
are  applied  to  priority  scheduling  problems.  He  also  defines 
the  completion  time  of  the  n^^  arrival  as  the  sum  of  its 
service  time  and  all  of  the  interruptions  it  experiences. 

Kielson  [8]  obtains  limiting  forms  for  the  equilibrium 
distributions  of  an  M/G/1  queue  subject  to  interruptions  with 
Poisson  incidence.  He  defines  three  exclusive  and  exhaustive 
states  that  provide  a Markovian  characterization  of  the  server 
process : 

Interruption  state  — I{Xq,x^) — The  service  has  been 
interrupted.  Time  x^  has  elapsed  since  the  last 
interruption,  when  the  total  service  time  Xq  has 
been  received  by  the  customer. 

Free  state — F:  (Xg) — Customer  is  being  served  and  has 
now  received  a total  Xg  of  service  time. 

Rest  state — R — The  customer  has  completed  service. 

The  Laplace  transforms  of  the  probability  densities 
of  being  in  states  I and  F and  the  distribution  of 
the  busy  period  and  the  effective  service  times  are 
developed . 
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and  Naor  [9]  analyze  a system  in  which  service 
is  interrupted  occasionally  by  breakdowns.  Five  models  are 
examined:  1)  breakdowns  occurring  according  to  a 

time-homogeneous  Poisson  process  (preemptive  priority  is  shown 
as  a special  case  of  this);  2)  breakdowns  occurring  only 
during  a service  duration;  3)  repair  service  not  starting  with 
the  server  idle;  4)  repair  starting  at  the  request  of  a 
customer;  5)  breakdowns  only  occurring  while  a customer  is 
being  served.  The  expected  queue  lengths^  the  expected 
remaining  active  service  time  required  by  the  leading 
customer,  and  the  remaining  time  to  station  repair  are  derived 
by  developing  the  probabilities  that  the  server  is  either  out- 
“Order  or  available  for  service.  Those  probabilities  are 
then  used  as  the  basis  of  calculations  using  the  fact  that  the 
service  station  goes  through  a cycle  of  two  phases:  for  a 

period  of  time  it  is  operative;  then  it  breaks  down,  and  after 
completion  of  repair  the  cycle  starts  again. 

Avi-Itzhak  [5,6]  derives  expressions  for  the  expected 
queue  length  and  the  queueing  time  for  a ' system  with  a 
single-station  subject  to  random  breakdowns  with  infinite 
customer  population.  The  service  time  is  fixed  but  the 
service  rate  is  varied  randomly.  The  similarity  of  that 

system  to  the  preemptive-priority  system  is  shown  and  the 
preemptive-repeat  discipline  is  solved  as  a special  case.  The 
first  study  [5]  considers  the  case  of  fixed  service 
requirements  and  varying  service  rates  (the  system  being 
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independent  of  the  past  preemptions  and  past  wasted  time) . 
The  second  study  [6]  considers  the  case  of  fixed  service  rate 
but  varying  customer-service  demands  (the  system  dependent  on 
the  number  of  past  preemptions  and  past  wasted  time) . 

Jaiswal  [7]  reviews  previous  results  of  worlc  on  priority 
queues.  Although  preemptive  disciplines  are  considered,  the 
major  thrust  is  completion-time  and  busy-time  analysis.  The 
analysis  is  accomplished  by  studying  the  busy— period  process 
and  the  idle-period  process  individually  and  then  combining 
these  results  using  renewal  theory.  The  main  results  for 
preemptive  priority  models  are  the  Laplace  transforms  of  the 
completion  time  and  the  probability  of  an  ordinary  job  being 
present . 

Kleinroclc  [29]  presents  priorities  relating  to  M/G/1  and 
G/G/1  systems  for  both  the  preemptive  and  nonpreempt ive 


service  disciplines. 


The  Laplace  transforms  for  the 


probability  density  function  of  the  generalized  busy  period, 
the  waiting  time  density,  and  the  service  time  durations  are 
calculated. 


Panayiotopoulos  [30]  presents  a general  computational 
algorithm  for  solving  systems  with  preemptive  and 
nonpreempt ive  priorities.  The  system  considered  is  one  in 
which  the  priority  indices  can  increase  perpetually,  with  one 
being  the  lowest  priority.  The  distribution  of  departures  is 
a general  distribution  (G)  , and  the  arrival  distribution  is 
general  independent  (GI) . 
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Sztrik  [31]  treats  a machine-interference  model  with  r 
servers  that  can  be  shared  and  preemptive  resume  last-come- 
first-serve  discipline.  He  derives  the  stationary  probability 
of  each  state  of  this  model. 

Fakinos  [32]  presents  expressions  for  the  queue  size 
limiting  distribution.  A single-server  last-come-f irst-serve 
queue  discipline  and  preemption  with  arbitrary  restarting 
policy  is  considered.  The  system  is  observed  at  arrival  or 
departure  epochs  in  continuous  time. 

Wolff  [1]  presents  results,  the  delays  for  jobs  of 
different  priority  classes  and  the  expected  completion  times 
for  many  different  models.  The  models  most  closely  related  to 
our  work  and  the  results  given  are  the  average  delay  for  a job 
of  the  j^^  priority  class  for  an  M/G/1  queue  with  preemptive- 
resume  priorities;  the  ‘ work  in  the  system,  V,  found  by  an 
arrival  of  a low  priority  job;  the  expected  value  of  the  time 
until  V has  been  performed  and  the  system  is  clear  of  high 
priority  jobs;  the  completion  time  of  a low  priority  job  which 
is  defined  as  the  time  from  when  service  begins  on  the  low 
priority  job  until  service  is  completed;  for  an  M/G/1  queue 
with  general  preemptive  rules,  the  probability  of  finding  a 
high  priority  job  busy  period  in  progress,  and  the  probability 
of  not  finding  a low  priority  job  completion  time  in  progress. 

Wolff  [1]  also  presents  some  results  for  the  M/G/1  queue 
with  generalized  vacations.  In  general,  if  server  vacations 
are  allowed  at  any  time  (either  during  service  or  when  the 
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server  is  idle)  , this  queue  is  similar  to  a preemptive 
priority  queue.  However,  his  model  assumes  that  all  vacations 
begin  only  at  a service  completion.  This  model  is  thus 
different  from  the  one  proposed  in  this  work. 

Muntz  et  al . [33]  presents  an  approximation  technique  for 
determining  the  steady-state  availability  of  computer 
communication  systems  with  Markov  models.  They  justify  the 
use  of  Markov  models  because  previous  realistic  models 
developed  state-spaces  that  were  too  large  to  generate  the 
transition  rate  matrix  necessary  to  solve  for  the 
availability . 


Approach 

Past  approaches  to  performance  evaluation  of  computer 
systems  include  the  use  of  direct  monitoring,  simulation, 
Markov  models,  and  queueing  models  [34,35,36]. 

Queueing  models  are  important  tools  because  they  achieve 
a favorable  balance  between  accuracy  and  efficiency  [36]. 
Past  experience  has  shown  that  queueing  network  models  can  be 
expected  to  be  accurate  to  within  5 to  10  percent  for 
utilizations  and  throughputs  and  to  within  10  to  30  percent 
for  response  times  [36] . 

One  of  the  most  used  queueing  models  is  the  round-robin 
model  [34,35],  which  does  not  allow  the  server  to  process  a 

X. 

job  for  a time  longer  than  a given  quantum  q.  If  the  service 
time  required  by  the  job  exceeds  q,  the  processing  of  the  job 
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is  interrupted  after  q and  it  is  returned  to  the  back  of  the 
f irst-come-f irst-served  queue. 

The  special  structure  (population  size  of  one  for  each 
priority  class)  of  our  models  and  the  performance  measures 
that  we  have  defined  make  the  results  of  past  work 
inapplicable.  This  is  one  of  the  aspects  of  this  dissertation 
that  distinguishes  it  from  past  work  on  queueing  theory  and 
computer  system  evaluation.  Another  distinguishing  feature  is 
the  approach  used. 

Past  approaches  to  computer  system  performance  evaluation 
have  used  simplified  models  such  as  M/M/1  queue  without 
priorities.  While  that  model  with  the  use  of  assumptions  may 
suffice  for  some  cases^  it  will  not  work  for  our  system.  Also 
in  reference  to  solution  techniques,  most  of  the  past 
literature  focusses  on  the  performance  measures  such  as 
expected  queue  length  or  expected  waiting  time.  The  results 
of  such  work  are  obtained  by  either  using  state  transition 
probabilities  or  differential-difference  equations  to  obtain 
the  generating  functions  of  the  distributions  of  the 
performance  measures  of  interest . 

Three  approaches  were  used  in  this  dissertation.  The 
discrete-time  models  allowed  use  to  use  a simple  4 step 
approach  which  can  be  outlined  as 

1.  Identify  the  one-step  transitions  for  the  states  of 
the  system. 

2.  Solve  for  the  defining  equation  for  each  state. 
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3.  Solve  for  the  state  probability  masses  where  the 
states  are  defined  by  the  remaining  service  times 
of  each  job. 

4.  Sum  the  probability  masses  to  get  the  probability 
of  being  in  each  state  and  the  performance 
measures . 

This  approach  had  to  be  adapted  slightly  for  the  models 
with  unbounded  continuous-time  state  spaces.  Since  the 

service-time  distributions  are  continuous  and  unbounded, 
Markov  models  were  used  to  find  some  of  the  performance 
measures.  The  resulting  7 step  approach  can  be  described  as 

1.  Write  equations  conditioning  the  state  of  the 
system  at  time  t+dt  on  the  state  of  the  system  at 
time  t. 

2.  Solve  for  the  defining  differential  equations. 

3.  Define  the  special  property  for  the  specific  model 
as  given  in  Result  2 in  Chapter  3. 

4 . Solve  the  differential  equations  for  the 

probability  densities  of  the  remaining  service 
times  in  the  different  subspaces. 

5.  Integrate  and  sum  these  densities  for  some  of  the 
performance  measures . 

6.  Use  Markov  models  to  solve  for  the  initial  waiting 
time  of  the  j-job. 

7 . Use  the  results  from  steps  5 and  6 to  calculate  the 
remaining  performance  measures. 
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The  structure  of  the  models  with  bounded  service-time 
distributions  allowed  us  to  solve  for  all  of  the  performance 
measures  directly  from  the  density  functions.  The  5 step 
approach  used  for  these  models  is  given  as 

1 . Write  equations  conditioning  the  state  of  the 
system  at  time  t+dt  on  the  state  of  the  system  at 


2 

3 


4 


5 


time  t. 

Solve  for  the  defining  differential  equations. 
Define  the  special  property  for  the  specific  model 
as  given  in  Result  2 in  Chapter  3. 

Solve  the  differential  equations  for  the 
probability  densities  of  the  remaining  service 
times  in  the  different  subspaces. 

Integrate  and  sum  these  densities  for  the 
performahce  measures. 


The  special  structure  of  the  systems  addressed  allow  the 
density  functions  of  the  variables  that  describe  the  entire 


state  space  to  be  specified  in  closed  form.  These  can  then  be 
used  to  calculate  the  performance  measures  of  interest . This 
approach  allows  the  evaluation  of  the  system  not  only  by  the 
numerical  values  of  specialized  measures,  but  also  by  the  full 
specification  of  the  state  space. 

These  approach  is  unique  to  this  work  since  most  past 
work  uses  generation  functions  after  step  2.  In  this  work, 
the  probability  density  functions  are  solved  directly  from  the 
differential  equations. 
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In  Chapter  2,  two  discrete  state-space  models  with 
geometric  arrivals  are  analyzed.  First  the  model  with  general 
service  time  distribution  is  discussed,  and  then  the  model 
with  deterministic  service  time  distribution  is  analyzed. 
Then,  in  Chapter  3 continuous  state-space  models  with 
exponentially  distributed  arrivals  are  studied  for  the 
unbounded  service  time  distributions;  first  the  general 
distribution  is  discussed  and  then  results  for  the  exponential 
distribution  is  presented.  Chapter  4 presents  results  for 
continuous  state— space  models  with  bounded  service  time 
distributions;  models  with  deterministic  service  times  and 
models  with  uniformly  distributed  service  times  are  analyzed. 

Chapter  5 is  devoted  to  the  discussion  of  the  two  other 


systems:  the  preemptive-resume  with  resume  penalty  and  the 
preemptive-resume  with  priority  switching.  Chapter  6 gives  a 
summary  of  the  results  and  a discussion  of  future  extensions 


of  this  work. 
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Figure  1 . 1 


Priority  Queueing  System 


Service  of  any  j-job  can  be  interrupted 
(preempted)  only  by  jobs  of  a higher  priority, 
i.e.  any  i-job  when  i<j. 
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Figure  1.2  Preemptive  Priority  Queueing  System 
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Figure  1.3  Arrivals  from  Populations  with  Infinite  Size 


Figure  1.4  Arrivals  from  Populations  with  Size  1 
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Applications: 

1 . Intensive-care  nurse 

2.  Microcontroller  with  hardware  interrupts 


Figure  1.5  Basic  Preemptive-Resume  Queueing  System 
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2.  Human  operator  reorganization  time 
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Figure  1.6  Preemptive-Resume  Queueing  System 

with  Resume  Penalty 
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1 . Jobs  submitted  to  a network  server 
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Figure  1.7  Preemptive-Resume  Queueing  System 

with  Priority  Switching 


A 


WO 


Wk-1,  SkJ 


nitlal 
Waiting  Time 


Virtual  Service  Time 


Virtual  Completion  Time 


Figure  1.8  Cycle  Time  and  its  Components 


CHAPTER  2 

DISCRETE-STATE  MODELS 
Introduction 

Consider  N jobs,  each  with  a distinct  priority,  to  be 
serviced  by  a single  server.  Let  the  service  times  of  the  i- 
job,  i=l,...,N,  be  k^A,  where  A refers  to  the  cycle  time,  and 
ki  is  a nonnegative  integer.  The  state  of  the  system  at  cycle 
n is  determined  by  the  vector  X(n)=[Xi(n),  X2(n),...,  X^(n)], 
where  X^  (n)  is  the  remaining  number  of  service  cycles  left  for 
job  i.  Xj^  (n)  =0  implies  that  the  i — job  is  not  currently 
present  in  the  queueing  system.  Notice  that  among  the  jobs 
present  in  the  system,  the  highest  priority  job  is  the  one 
being  served.  Again,  let  the  lower  index  job  have  priority 
over  the  higher  index  job.  This  discrete  state  space  model 
gives  rise  to  a Markov  chain  model  with  (k^  + l)  (k2  + l)  . . . (kj^+1) 
states . 

The  transition  from  one  state  to  the  another  represents 
the  changes  in  the  system  over  the  course  of  one  cycle. 
Suppose  an  i— job  arrives  when  a j~job,  j>i,  is  being  served; 
let  the  j-job  have  m^  cycles  of  remaining  service  time.  We 
assume  that  the  i-job  arrives  at  the  end  of  a cycle  and 
preempts  the  j~job.  When  the  i-job  completes  service  after  k^ 
cycles,  provided  that  no  other  jobs  with  a priority  higher 
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than  j have  arrived  during  the  k.-  cycles,  the  j~job  will 
continue  its  service. 

Once  the  1-job  has  started,  it  will  proceed  through  all 
ki  stages  before  any  other  job  is  continued.  For  two  jobs, 
there  are  (ki  + l)(k2+l)  states,  denoted  by  (X^  (n)  , X2  (n)  ) where 
X^  (n)  is  the  number  of  cycles  remaining  for  the  completion  of 
the  i-job  at  time  epoch  n. 

The  motivating  application  for  this  model,  as  mentioned 
in  the  introduction,  is  in  the  analysis  of  certain  computer 
systems.  Specifically  the  central  processing  unit  carries  out 
instructions  following  a regular  system  clock.  Modern 
microprocessors  have  system  clocks  with  periods  (cycle  times) 
less  than  one  microsecond.  Thus,  the  discrete  state-space 
model  is  a suitable  model. 

General  Service  Time  Distribution:  M/G/1/2/2/1  Model 

Let  Pi(*)  be  the  probability  mass  function  of  service 
time  for  the  i-job.  That  is 

Prob[k^=x] for  i = l,2  and  x=  1 , 2 , 3 . . . (2.1) 

We  now  formulate  the  defining  equations  for  the  model  in 
which  the  time  increments  that  define  that  state  transitions 
are  assumed  to  be  discrete.  We  will  also  assume  that  the 
probability  mass  functions  of  the  service  times  are  general 
and  are  represented  by  p^  (r^)  and  P2(r2)  for  the  1-job  and  2- 
job  respectively. 
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n the 
and  j 


Let  P(i,  j,n)  represent  the  probability  that  at  time  epoch 
system  is  in  the  state  where  a 1-job  and  2-job  have  i 
cycles  of  remaining  at  service  time. 

P ( i,  j , n)  = Proh[X^  (n)  -i,  X^in)  - j] 

Let  the  steady-state  probability  masses  be  define  as 


P^i,j)=  n^P{i,jrn) 


Let  Pi  (i=l,2)  represent  the  probability  of  the  arrival 
of  an  i-job  at  the  end  of  a cycle  provided  that  job  i was  not 
present  in  the  system  at  the  beginning  of  the  cycle. 

A sample  realization  of  this  process  is  given  in  Figure 

2.1. 


One-step  transition  probabilities  are  obtained  by 
conditioning  the  state  of  the  system  at  the  end  of  cycle  n+1 
on  the  state  of  the  system  at  the  end  of  cycle  n. 

In  the  following  development,  when  obvious,  the  time 
parameter  n is  suppressed  and  the  state  of  the  system  is 
described  by  the  pair  ( i , j ) = (Xj  (n)  =i , Xj  (n)  = j ) . State  (i,0)  can 
be  reached  from  either  state  (i+1,0),  provided  that  a 2-job 
does  not  arrive,  or  from  state  (0,0)  if  a 1— job  arrives  with 
a service  time  of  i cycles  and  a 2— job  does  not  arrive.  From 
state  (0,0),  state  ()Ci,0)  follows  if  a 1 — job  arrives  with  a 
service  time  of  cycles  and  a 2- job  does  not  arrive.  These 
transitions  are  shown  in  Figure  2.2a.  For  those  states  where 
there  is  only  a high  priority  job  present,  states  (i,0) 
(i  = l,..,ki),  we  write. 
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PU,0,  n + 1)  = P{i  + l,0,n)  (l-Pj) 

+ P (0 , 0 , n)  p,f,{i)  (I-P2) 


(2.2) 


Similarly,  for  states  (0,j)  (j  = l,..k2),  the  states  where 
only  a 2- job  is  present,  we  have,  as  shown  in  Figure  2.2b, 


P{0,  j,  n + 1)  = P(0,j  + l,n)  (1-  pj) 

+ P(l,  j,n)  + P{0,0,  n)  (1-Pi) 


(2.3) 


Finally,  for  states  (i,j),  (i>0,  j>0) , shown  in  Figure 


2.2c,  we  have. 


p(i,j, t + l)  = P(i  + l,j,t)  + P(i,0,  t)  p.f^ij) 

+ P (0,  j,  t)pjf.  (i) 


(2.4) 


Deterministic  Service-T j.mes : M/D/1/2/2/1  Model 

We  first  consider  the  case  of  two'  jobs  with  different 
priorities,  where  the  1-job  has  the  higher  priority  and  thus 
always  preempts  the  2-job.  If  each  time  epoch  takes  a 
constant  time  A,  the  entire  job  i will  take  A times  k^  to 
complete . 

State  (0,X2(n))  means  that  the  1-job  is  not  in  the  system 
and  the  processor  is  executing  the  2-job.  Similarly,  state 
(X,  (n),0)  means  that  the  1-job  is  being  executed  and  the  2-job 
is  not  in  the  system;  that  is,  it  has  not  arrived  since  its 
last  completion. 

Similar  to  the  development  of  equations  2.2,  2.3,  and 
2.4,  we  write , 


P(kj,0,n  + 1)=  P(0,0,n)p,  (l-Pj)  + P(0,  1,  n)pj 


(2.5) 
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The  state  (ki,0)  can  be  reached  in  two  ways:  the  system 
is  idle  when  a 1-job  arrives  and  no  2-job  arrives,  or  the 
system  completes  processing  the  2- job  when  a 1-job  arrives. 

For  those  states  when  there  is  only  a high-priority  job 
present,  we  write, 

P(i,  0,n  + l)  = p(i  + l,  0,n)  (I-P2)  i = (2.6) 

Equation  2.6  reflects  that  the  system  will  reach  state 
(i,0)  only  if  a 1-job  arrived  k^-l  cycles  ago  while  the  system 
was  idle,  and  a 2-job  has  not  arrived  during  the  previous  k-,-i 
cycles . 

If  a 2-job  does  arrive  during  the  servicing  of  the  1-job, 
the  system  enters  to  the  state  (i,k2).  Since  the  1-job  has 
the  higher  priority,  its  service  is  not  affected  by  this 
arrival.  This  transition  is  represented  by  the  first  term  in 
equation  2.7: 

P{i,k^,n  + 1)  = P(i  + l,0,n)p2+  P(i  + l,k2,n)  i = l,  . . , k^-1  (2.7) 

The  second  term  in  equation  2.7  refers  to  the  fact  that 
once  the  system  enters  state  (i,kj),  the  2- job  remains  in  the 
queue  for  i cycles  until  the  completion  of  the  1-job. 
Equation  2.7  does  not  hold  for  states  (0,k2)  and  (kj,k2)  . 
These  states  are  explicitly  described  in  equations  2.8  and 
2.9. 

P {0 , k^,  n + 1)  = P {0 , 0 , n)  (1  -p^ ) + P (1 , 0 , n)  p^ 

+ P{l,k,,n) 


(2.8) 
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P (k.^,  k^,  n + 1)  = P(0,0,n)pjP2 


(2 . 9) 


As  shown,  state  (0,k2)  can  be  reached  either  by  the  same 
transitions  described  by  equation  2.7,  or  by  the  system  being 
idle  and  a 2- job  arriving  while  no  1-job  arrives. 

Equation  2.8  shows  that  state  (ki,k2)  can  happen  only  by 
the  simultaneous  arrival  of  both  jobs. 

After  the  system  reaches  state  (0,k2),  it  proceeds  to 
process  the  2- job  since  it  is  the  only  job  present.  This  is 
represented  in  the  first  term  of  equation  2.10  : 


The  second  term  shows  that  the  system  can  reach  states 
(0,j)  by  the  completion  of  the  1-job  with  the  2-job  having  j 
cycles  of  service  remaining.  That  is,  this  second  term  is  due 
to  the  previous  preemption  of  the  2-job  (at  the  end  of  cycle 
n-(ki-l)).  This  preemption  is  described  in  equation  2.11. 

The  system  reaches  states  (kj,j)  by  the  arrival  of  a 1- 
job  while  the  2-job  is  being  processed.  This  transition  marks 
the  beginning  of  an  in-process  waiting  period  for  the  2-job. 


P(0,  j,n  + l)=  P(0,  j + l,n)  (1-Pi) 

+ P{1,  j,  n) 


(2.10) 


That  is,  since  the  high  priority  1-job  is  present,  it  is 


processed  to  completion. 
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The  one-step  transitions  between 

the 

states 

of  the 

M/D/1/2/2/1  model  provide  defining  equations 

for  the 

steady- 

state  probabilities. 

• 

PUCj,  0)  = P(0,  0)Pi  (I-P2)  + P(0,  DPi 

(2 . 13) 

P(i,  0)  = P(i  + 1,  0)  (I-P2) 

. , kj-1 

(2.14) 

P(i,k^)=  P(i  + l,0)p2+  P{i  + l,k^) 

i = l,  . 

.,^1-1 

(2 . 15) 

P{Q,k^)=  P(0,  0)P2  (1-Pi)  + P(1,0)P2+  P(l,k2) 

(2.16) 

P(k^,  k^)  = P (0,  0)  P1P2 

(2.17) 

P(0,  j)  = P(0,  j + 1)  (1-Pi)  + P(l,  j) 

j = l,  • 

.,^2-1 

(2.18) 

P(ki,  j)  = P(0,  j + l)Pi 

j = l,  . 

. , ^2  - 1 

(2.19) 

, P a,  j)  = P {i  + 1 , j)  i = l,..,k^-l 

. , ^2-1 

(2.20) 

The  Steady-State  Probabilities 

We  now  proceed  to  solve  equations  2.13  to  2.20  in  order 
to  evaluate  the  steady-state  probabilities.  Using  equation 
2.14,  by  induction  we  have, 

P(i,0)  = P{k^,0)  (1-p,)'^'-^  i = (2.21) 

The  probabilities  of  states  (i,0)  follow  a geometric 
sequence,  with  factor  {I-P2)  . Similarly,  equation  2.15  and 
induction  gives 

P{i,k,)  = P{k,,0)  (l-d-p^)*'-^) 

+ P{k,,k^)  i = l,  . . , p,-i 

This  equation  is  also  consistent  for  i=ki . Substituting 
equations  2.21  and  2.22  into  equation  2.16,  we  have 


(2.23) 


P (0 , k^)  = P {k^,  k^)  + P {0 , 0)  {1  -pj ) 

+ P(k^,  0)  [ (I-P3)  (P2-I)  +1] 

Now,  expanding  equation  2.20,  we  have 
P a,  j)  = P {2 , j)  =•  • • =P  {k^,  j)  j = l , . . , k^-l 

That  is,  for  a given  j,  the  probability  of  being  in  any 
state  from  (l,j)  to  (k|,j)  is  the  same.  Substituting  into 
equation  2.19  gives 

P{i,j)~  P{k,,j)=  P(0,  j + l)p. 

(2.24) 

i = l,..,l:,-l  j = l , . . , k^-l 
Substituting  into  equation  2.18  we  obtain 

P(0,  j)  = P(0,  j + 1)  = P(0,;c2)  j = l,..,Jc2-l  (2.25) 

Substituting  baclc  into  equation  2.24, 

P(i,  j)  = P(0,  j + l)p, 

(2.26) 

^P(0,k^)p^  i-l,..,k^-l  j = l,..,k2-l 

Equations  2.25  and  2.26  mean  that  the  probability  masses 
for  all  of  the  states  (0,  j)  ( j = l,  . .Icj)  are  all  the  same  with 
their  value  being  P(0,k2),  and  the  probability  masses  of  all 
of  the  interior  states  (i,j)  (i  = l,..,k,,  j = l,..,k2)  are  also 
the  same,  and  their  value  is  P(0,k2)Pi.  Substituting  P(0,j) 
from  equation  2.25  into  equation  2.13  we  get, 

P(k, , 0)  = P (0,  0)p.  (I-P2)  + P(0,  k2)p.  (2.27) 


and  with  equation  2.23, 


44 


P{k,,0) 


P ( 0 , 0 ) Pi  ( 1 -piPj ) + P{k^,k^)p^ 

(I-P2) 


Using  P(ki,k2)  from  equation  2.17,  we  have 


P(k,,  0) 


P(0, 0)Pi 
(I-P2)'' 


(2.28) 


Although  it  was  not  explicitly  noted,  this  is  consistent 
with  equation  2.21  with  i equal  to  kj . 

From  equation  2.27  we  solve  for  P(0,k2),  yielding, 

P(0  k [Pik,,0)-  P(0,0)Pi(l-p2)  ] 

' Pi 

Substituting  P(ki,0)  from  equation  2.28,  we  have 


P(0,  ^2) 


P(0, 0) 


1-il-p,) 

(1-P2)'- 


(2.29) 


We  now  consider  a numerical  example  to  illustrate  the 
results  obtained.  Let  the  service  times  be  ki=k2=10  cycles. 
Let  the  arrival  probabilities  Pi=P2=0.5.  This  case  represents 
a highly  congested  system. 

The  state  probability  masses  for  different  values  of  i, 
the  remaining  service  time  of  the  1-job,  are  shown  in  Figure 

2.3. 

Summarizing  these  results,  the  entire  set  of  steady-state 
probabilities  can  be  given  by  equations  2.30,  2.31,  2.32,  2.33 
and  the  normalizing  condition  given  as  equation  2.34.  P(0,0), 
given  by  equation  2.35,  is  obtained  using  the  normalizing 


condition . 
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P(i,  0 ) = 


P ( 0 , 0 ) p. 

(I-P2)' 


P(i,k,)  = P(0,  0)p. 


1-(1-P2) 


ic,-i 


P(0,  j)  = P(0,  0) 


(1-P2)  ‘ 

1-  (1-P2) 
(1-P2)'' 


+ P: 


y 


PU,  j)=  P(0,0)Pi 


i-d-p^)*-^' 

(1-P2)'' 


^3 


P(i,  j)  = 1 


i=0  j=0 


P(0, 0) = 


-^+  (^Ci-l)  (P2-I) 

(I-P2)  ■ 


f 


i = l , . . , P. 


i = l , . . , A:. 


j — • • ! k. 


i = l , . . , A:,  -1 


j = l,  . . , k,-l 


\ 


Pi 

(1-P2)'‘ 


- Pi  (1  -P2  ) 


y 


Tl 


+ 


PlP2^1 


Pl^l 


(I-P2)  ■ 


+ - Pp  ( 1 -Pp  ) + 1 


(2 . 30) 

(2.31) 

(2.32) 


(2 . 33) 

(2.34) 


(2 . 35) 


Performance  Measures 

In  calculating  the  following  performance  measures,  the 
expected  times  are  given  in  cycles,  each  cycle  having  a 
(duration  of  A time  units;  therefore  these  expecte(d  values  can 
be  converted  to  time  units  by  multiplying  by  A.  P(0,0)  is  the 
proportion  of  time  that  the  server  is  idle  (neither  serving 
the  1-job  nor  the  2-job) . 

Figure  2.4  shows  the  variation  of  the  probability  of  the 
server  being  idle  when  the  arrival  rates  of  the  jobs  are 
varied.  As  expected,  when  the  probability  of  arrival  of 
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either  the  1-job  or  the  2-job  increases,  the  system  is  more 
congested,  or  equivalently,  the  server  is  busier. 

The  expected  duration  of  the  idle  period  can  be 
calculated  by  considering  all  the  priority  classes  as  one 
class.  This  aggregate  class  will  have  a geometric 
interarrival  time  distribution  with  parameter  Pi+P2~PiP2-  The 
expected  interarrival  time  of  the  aggregate  class  is  also  the 
expected  idle  period. 

E[Duration  of  the  idle  period]  = (2.36) 

P1+P2-P1P2 

The  in-process  waiting  time  for  the  2-job  is  the  number 
of  cycles  spent  in  the  internal  states  {(i,j):  i=l,..,ki-l, 

j = l , . . , kj-l } . States  in  correspond  to  the  2- job  being 

preempted  and  waiting  in  the  queue.  The  probability  that  the 
2-job  is  preempted  and  waiting  in  the  queue  is  calculated  by 
summing  equation  2.33  over  i=l,..,  k^-l  and  j=l,..,k2-l. 


Prob[Xe  ] = 


^ f]  P{i,  j) 

i-i  pi 


f 


= (k,-l)  (k2-l)P(0,  0)p. 


V 


l-d-Pj)'-*' 

(1-P2)'‘ 


A 


(2.37) 


y 


Figure  2.5  shows  the  response  of  the  probability  of  the 
2-job  being  in  when  p^  and  P2  are  varied. 

The  average  in-process  waiting  time  of  the  1-job  is 
always  0^  since  it  has  the  highest  priority,  and  thus  goes 
directly  into  service  and  is  processed  to  completion.  The 
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value  of  the  in-process  waiting  time  of  the  2-job  depends  on 
mainly  on  the  number  of  times  the  2-job  gets  preempted,  which 
in  turn  depends  on  the  1- job's  arrival  rate,  or  alternatively, 
its  probability  of  arriving  during  the  processing  of  the  2- 
job.  The  in-process  waiting  time  also  depends  on  k2  since  the 
larger  k2  is,  the  more  likely  that  there  will  be  an  arrival  of 
the  1-job  during  that  service  period. 

We  next  evaluate  the  expected  total  in-process  waiting 
for  the  2-job.  It  is  known  that  the  2-job  always  starts  from 
state  (0,k2)  . After  this  state,  the  system  could  process 
through  states  {(0,j):  j=l,..,k2).  During  these  transitions, 
a 1-job  could  preempt  the  2-job  and  cause  it  to  wait  for  k^A 
cycles.  Since  the  probability  of  a 1-job  arrival  during  a 
cycle  is  p^. 


>1 


(2 .38) 


The  virtual  service  time  for  the  1-job  is  equal  to  its 
normal  service  time,  k^ . However,  for  the  2- job,  the  virtual 
service  time  is  equal  to  k2  delayed  by  the  in-process  waiting 
time.  Notice  that  the  virtual  service  time  of  a 2- job 
excludes  its  initial  waiting  time.  The  probability  that  the 
2-job  is  present  and  is  not  in  its  initial  waiting  period, 
that  is  the  probability  of  being  in  state  is  calculated 
as 
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Prob  [Xe  S P ( 0 , j)  + Prob  [Xe  ] 

j-i 

(2.39) 

= P(0,0) ^ (k2+  (k^-1)  (ATj-DPj) 

Figure  2.6  shows  a graph  of  values  of  this  probability 
when  Pi  and  P2  are  varied. 

The  expected  virtual  service  time  is  the  sum  of  the 
expected  service  time  (Tg,2))  and  the  expected  in-process 
iting  time  of  the  2-job.  Measured  in  service  cycles,  the 
expected  virtual  service  time  of  a 2-job  is 


E [ T^,,,  ] = £ [ ] + £ [ T^,,,  ] = k^a  + Pi/Cj ) 


(2 .40) 


The  probability  of  the  2-job  being  in  its  completion  time 
is  equal  to  the  probability  of  it  being  in  either  or  . 
The  probability  of  it  being  in  is  found  by  summing 
equation  2.31  for  values  of  i from  1 to  kj  . 


Prob[Xe  ] = T.P{i,k^) 

i = l 


k. 


p ( 0 , 0 ) p. 


r 


Pz^l  + 


k. 


l-d-p^)*'*' 


(2.41) 


-1 


V 


(1-P2)^‘  P2(l-P2)''' 


J 


A graph  showing  values  of  this  probability  is  shown  in  Figure 


2.7. 


The  2-job  experiences  an  initial  waiting  period  anytime 
it  arrives  during  the  serving  of  the  1-job.  The  probability 
of  this  arrival  during  any  service  cycle  is  P2,  and  if  the 
arrival  occurs  while  the  1-job  is  in  state  (i,0),  the  wait  is 
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i-1  cycles.  Thus^  the  expected  initial  waiting  time  of  a 2- 
job  is 


k. 


Ep2i  = 

i = l 


(k^+1) 

2 


(2 . 42) 


Using  this  result,  the  probability  that  the  2-job  is  in 
the  system  is  given  by  summing  equations  2.39  and  2.41.  The 
expected  completion  time  of  the  2- job,  shown  in  Figure  2.8,  is 
the  sum  of  the  expected  virtual  service  time  and  the  expected 
initial  waiting  time. 


E[  T^,„]  - k^  (1  + p^k,  ) + 


p^k^  {k,+  1) 

n — 


(2.43) 


If  the  completion  time  is  added  to  the  interarrival  time, 
the  entire  cycle  of  the  2-job  is  obtained.  The  expected 
virtual  interarrival  period,  the  inverse  of  p^,  is  therefore 
the  sum  of  the  expected  completion  time  and  the  expected 
normal  interarrival  period.  The  inverse  of  this  sum  will  then 
be  the  virtual  arrival  rate. 


E 


1 


E [ ] + _ 

P2 

;c2  (1  + p■^k,)  + 


p^k^  +1) 
2 


(2.44) 


As  shown  in  Figure  2.9,  the  probability  of  arrival  of  a 
2-job  decreases  when  the  value  of  either  p,  or  of  Pj 
increases . 

As  defined  earlier,  the  delay  factor  for  the  2-job  d*^’  is 
the  ratio  of  the  sum  of  the  expected  in-process  waiting  time 
and  the  expected  initial-waiting  time  to  the  expected  service 
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time.  This  increases  linearly  since  the  expected  initial- 
waiting time  (equation  2.38)  and  the  expected  in-process 
waiting  time  (equation  2.42)  increases  linearly  with  P2  and  p^ 
respectively . 


E [ T^^2,  + T^u)  ] 


P2  (l  + ^i) 

71^2 


(2.45) 


Figure  2.10  shows  a graph  of  the  2- job  delay  factor  as  p^ 
and  P2  are  varied. 


Figure  2.1  Realization  of  the  Discrete-State  Model 


From 

(0.0) 


Figure  2.2  State  Transitions. 

a)  Transitions  to  States  (i,0); 

b)  Transitions  to  States  (0,j); 

c)  Transitions  to  States  (i,j); 

d)  Transitions  to  State  (0,0)  . 


Pr  ot)C  I d I • ] FV  Ob 
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DISCRETE  D/M/ D/ 1/ 2/ 2/ 1 MODEL 

Stat®  fVoto  . Ubbb«®  k1=ic2=i0.  p'1=®2=0 . 5 


□ 


po.o:) 


I ;CR®<wiInIno  Sorvica  Tima  of  1-Job^ 

po.k2:)  o pco.j:) 


PO.JD 


Figure  2.3  State  Probabilities 
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Figure  2.4  Probability  of  an  Idle  System 


p2=0 . 6 
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DISCRETE  D/M/ 1/2/ 2/1  MODEL 


+ P2-0.2  o p2=0.3  A p2=0.-4  X p2=0.5  V p2=0 . 6 


Figure  2.5  Probability  that  the  2-Job  is  Preempted 


p2=0. 1 


D I SCRETE  D/M/ 1/ 2/ 2/ 1 MODEL 


p1 

A p2=0.4  X p2=Q.5  y p2=0 . 6 


Figure  2.6  Probability  that  the  2-Job  has 

Received  Partial  Service 


54 


p2=0 . 1 


p2=a . 1 


DISCRETE  D/M/1/2/2/1  MODEL 


+ p2=0.2 


O p2=Q.3 


P1 

A p2=Q.4 


X p2=Q.5 


Figure  2.7  Probability  that  the  2-Job  has 
Arrived  but  not  Received  Service 


DISCRETE  M/D/1/2/2/1  MODEL 


pi 
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F igure  2 . 8 


Expected  2-Job  Completion  Time 
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p2=Q. 1 
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Figure  2.9  2-Job  Virtual  Arrival  Probabilities 
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Figure  2.10  2-Job  Delay  Factor 


CHAPTER  3 

CONTINUOUS  STATE  MODELS  WITH 
UNBOUNDED  SERVICE  TIME  DISTRIBUTIONS 

Introduction 

The  continuous-time  continuous-state  model  developed  in 
this  chapter  can  be  considered  as  an  approximation  to  the 
discrete-time  discrete-state  model  described  in  Chapter  2. 
The  continuous  model  can  be  expected  to  be  a good 
approximation  to  the  discrete  model  when  the  cycle  time,  A,  is 
short  and  the  number  of  service  cycles,  k^,  is  large.  Such  is 
the  case  with  applications  in  computer  hardware.  However,  the 
continuous-time  continuous-state  model  stands  on  its  own  merit 
where  the  underlying  phenomena  are  continuous  in  nature.  This 
is  the  case  in  the  Intensive  Care  Unit  example  discussed  in 
Chapter  2 . 

« 

General  Service  Time  Distribution  Models 
The  state-space  is  first  described  for  the  2-class  case. 
The  state  of  the  i-job  at  time  t is  given  by  X.  (t)  which 
denotes  the  remaining  service  time  of  job  i.  X^(t)=0  means 
that  the  i— job  is  not  in  the  system,  i.e.  it  has  not  arrived 
since  its  last  completion.  The  state  of  the  system  X(t)  at 
time  t is  given  by  the  vector  (r^,r2)  where  r^  is  the  remaining 
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service  time  for  the  i-job.  That  is,  X(t)  = (r,,r2)  specifies 
that  Xi(t)=ri  and  X2(t)=r2.  When  ambiguous,  we  will  use  the 
notation  X ( t ) = ( r^ , rj,  t ) . 

The  set  of  all  system  states  constitute  a quadrant  as 
shown  in  Figure  3.1.  A sample  realization  of  this  system  with 
2 priority  classes  is  shown  in  Figure  3.2. 

The  origin  (0,0)  represents  an  idle  system.  There  is  a 
probability  mass  Pq  associated  with  the  origin,  the 
probability  that  the  server  is  idle. 

The  states  on  either  axis  are  where  only  one  job  is  in 
the  system.  On  the  horizontal  axis  are  states  (ri,0),  and  on 
the  vertical  axis,  states  (0,r2)  . The  probability  densities 
associated  with  these  states  are  denoted  by  hi(-)  and  h2(-). 

The  interior  of  the  quadrant  is  where  both  jobs  are 
present.  Here,  the  1-job  is  being  served  while  the  2- job  has 
been  preempted.  Corresponding  to  the  interior  region  is  the 
joint  density  function  g(-,-). 

The  state— space  depends  on  the  service— time  distributions 
of  the  jobs.  If  both  jobs  have  bounded  service— time 
distributions,  the  state— space  is  also  bounded.  Moreover, 
when  the  2-job  has  a deterministic  service  time,  there  is  a 
probability  density  along  the  boundary  defined  by  the  state 
(ri,k2),  where  k2  is  the  deterministic  service  time  of  the  2- 
job  and  0<rj<oo.  Models  with  bounded  service— time 
distributions  will  be  discussed  in  Chapter  4. 
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2-Class  Case:  M/G/1/2/2/1  Model 

We  present  the  2-class  model  and  develop  defining 
equations  for  the  steady-state  probability  density  functions. 
First  the  state  probability  density  functions  are  formally 
defined . 

The  idle  state  of  the  server  has  a finite  probability 

Po (t)  / 


Po(t)  = Prob[X,  (t)  ^0,X,(t)  = 0] 

Similarly,  we  have  probability  densities  corresponding  to 
states  1 (t ) , 0}  and  i 0,  X2  (t ) 1 , 

hj  (rj,  t)  = ^Prob[Xj  (t)<r,,  X,{t)  =0] 
hj  (r^,  t)  = _^_Prob[Xi  (t)  =0,  X^it)  <r^] 

The  third  density  function  corresponds  to  states  where 
both  jobs  exist:  the  1-job  being  served,  and  the  2- job  in  the 
queue  either  preempted  or  never  been  served  since  its  arrival . 


g(rj,  r^,  t)  = ^ — Prob[X,  (t)  <r,,  X^(t)  <r,] 

ar,or^  ^ ^ ^ 


The  respective  steady-state  probability  density  functions 
hi(ri),  h2(r2>  and  gCr,,  r2)  are  defined  as  follows. 


V,)=  h,(r^,t) 


for  i-  1,2 


g(r,,  r2)=  g (r,,  r^,  t) 
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_ Lim 
Po- 


Po  (t) 


Exponentially  distributed  interarrival  times  and  service 
times  with  general  distributions,  fi(r,)  and  f2(r2),  give  rise 
to  the  following  equations.  These  equations  are  obtained  by 
conditioning  the  state  of  the  system  at  time  t+dt  on  the  state 
of  the  system  at  time  t. 

hi  (r,,  t+dt)  = hi  (ri+dr,  t)  (1-X^dt)  + (P ) 

Letting  t — > °o, 


dhi  ( ri ) 

Hr, 


^2-^1  (-^i)  ~ Po^iA  (-^i) 


(3.1) 


Similarly, 

h^  (r^,  t+dt)  = {r^  + dr,  t)  (1-Xidt)  + g{dr,  r^,  t)  dt 

+ P0X.2P2  (■^2') 

which  yields. 


and. 


dh^  ( ) 
dr^ 


A-ihj  ( r2 ) 


g(0,  r2)  - Po>^2-^2  (-^2) 


(3.2) 


g(ri,  rj,  t + dt)  = g(r^  + dr,  r^,  t)  + (r._,  t)  {r^)  dt 

+ {r^,  t)  X^f^  (r^)  dt 


dg(r,_,  r^) 
dr. 


hi  ( r,  )X^f^{r^)  - (r^)  X,f,  {r,) 


(3.3) 


Observing  equations  3.1,  3.2,  and  3.3,  it  is  seen  that 

3.1  can  be  solved  independent  of  3.2  and  3.3.  However,  3.2 
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and  3.3  cannot  be  solved  independently  nor  sequentially  with 
only  these  equations  since  3.3  needs  the  function  h2(r2)  and 
3.2  needs  the  function  g(0,r2)  . 

One  approach  is  to  find  an  independent  equation  for 
g(0,r2)  and  thus  solve  3.2  for  h2(r2>.  It  can  be  shown  that 
the  following  relationship  holds  true  for  this  system: 


Proposition  1.  For  the  M/G/1/2/2/1  system: 


g(0,  r^)  = 


(r^)  A.1+ 


oo 

r 


h,.  it)  dt 


j 

t=o 


Proof 

The  proof  is  based  on  the  discrete  model  as  the  cycle 
time,  A— K) . Consider  the  discrete  model  with  general  service 

time  distribution.  At  the  steady  state, 

P(i,  j)  = P(i  + 1,  j)  + P(i,  0)p2-f2  (2)  (1-Pi)  + P(0,  (i)  (I-P2) 

Expanding  this  equation  for  i gives 


P(l,  j)  = P(2,  j)  + P(l,  0)p2p2  (2)  (1-Pi)  + P(0,  j)PiPj  (1)  (I-P2) 
P(2,  j)  = P(3,  j)  + P(2, 0)p2p2  (2)  (1-Pi)  + P(0,  j)PiPj  (2)  (I-P2) 


P(/c,-l,  j)  = P{k,,  j)  + P (l-Pj)  + P (0 , j)  p^fAk^-1)  (I-P2) 

Substituting  and  summing  these  equations 


00 

p(i,  j)  = Lp  a,  0)  p^f^ij)  (i-Pj)  +Ep(o,  j)p,  p (i)  (1-P2) 

2=1  i=i  ^ " 


Now  considering  the  continuous  time  case;  let  1 cycle  be 
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A time  units.  Let  the  continuous  variable,  assume  values 

iA.  For  A approaching  0 we  have, 

P(i, 0)  = h,(r,)A,  P{0,  j)  = h^{r^)A,  P (i,  j)  = g(r,,  r^)  A^ 

In  evaluating  P(l,j)  as  given  above,  replacing  the 
summation  by  integration  and  taking  the  limit  we  have. 


r 


L -1  m 

g(A,  r^)  = )hj  (rj  P2p2  + hj  (r^)  (r^ ) dr, 


J 

A 


c c 

g(0,r^)-  h^{r^)  dr^+  h^{r^)  {r^)  dr 


J 

0 


J 

0 


OO  oo 

Pi^2  (-^2)  J^i  (-^1)  c?rj+  h^(r^)  Pijfi  ir^)  dr, 

0 X) 


r 


= p^f^ir^)  h^{r^)  dr^+  h^(r^)  p. 


J 

0 


/ /Q.E.D 


Combining  equation  3.2  and  Proposition  1,  we  have 


dh^  ( r^ ) 

dH 


= -X^f^(r^)  \ h^{t)  dt  - pj^^f^ir^) 


t=0 


(3.4) 


This  allows  the  entire  system  to  be  defined  by  three 
equations:  3.1,  3.3  and  3.4,  and  the  normalizing  equation. 
These  defining  equations,  summarized  as  follows,  can  now  be 
solved  sequentially. 
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J 

t=0 


dg(r^,  r^) 


= - h^(r^)'k^f^(r^)  - h^{r^)\f^{r^) 


Hr 


3-Class  Case:  M/G/1/3/3/1 

For  the  case  where  a maximum  of  three  priority  classes 
exist  in  the  system,  there  are  seven  probability  density 
functions.  As  in  the  M/G/1/2/2/1  case,  some  of  these 
functions  correspond  to  states  where  there  exist  jobs  of  only 
one  class,  hi(-)?  and  where  there  exist  jobs  from  pairs  of 
classes,  (■  , ' ) . Because  there  may  be  three-job  classes  in 
this  case,  we  have  an  additional  probability  density  function 
for  the  states  where  the  three  jobs  exists  in  the  system 
simultaneously,  Ujjs  • 

Assuming  exponential  interarrival  times  and  service  times 
with  general  distributions,  fi  (•  ) , f 2 ( • ) and  f 3 ( • ) , we  have  the 
following  equations. 

hj(r,,  t+dt)=  h,  (r^+dr,t)  (l-X^dt)  {1-X^dt)  + p^X^f^{r^)dt 
and  as  dt  -4  0, 


(3.5) 
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Similarly, 

h2ir2,  t+dt)  = h^ir^+dr/t)  (1-X^dt)  (l-X^dt) 

+ g^2  (dr,  r^,  t)  dt  (1  -X^dt)  + p^X^f2  (r^)  dt 


dh^  (r^) 
dri 


= (X1+A.3)  h^ir^)  ~ r^)  - PoX^f^  (r^) 


(3.6) 


As  in  the  2-class  case,  this  differential  equation  has  a 
term,  namely  gi2(0,r2),  which  ties  it  to  the  state  ( O'",  r2,  Ol  , 
where  1-jobs  exist  with  2-jobs  simultaneously,  but  the  1-job 
is  just  about  to  complete  service. 

The  third  density  function,  h3(r3)  is  evaluated  as 


h^ir^,  t+dt)  = h^ir^  + dr,  t)  (1-X^dt)  {l-X^) 

+ ^33  (dr,  r3,  t)  dt  ( 1 -^2^t) 

+ ^23  (dr,  r3,  t)  dt  (l-Xjdt)  + p^X-^f^  (^3)  dt 


dh^ir^) 

dra 


( + A-2  ) ^3  ( r3  ) g33(0,r3)  g23i^r  ^3) 

Po^3^3  ( rj  ) 


(3.7) 


Note  that  because  this  equation  is  derived  for  the  3- 
jobs,  it  contains  terms  that  tie  it  to  two  different  states, 

{ 0'",0,r3l  and  I 0,0'",r3l  . 

Next,  for  the  states  where  1-jobs  and  2-jobs  exist  in  the 
system  simultaneously,  we  have: 


gi2  (r,  , rj,  t+dt)  = gi2  (r^+dr,  r2,  t)  (l-X^dt) 

+ h,  ( r^ , t ) ^2  ^2  ( -^2 ) dt 
+ h2  ( r2 , t ) ^,  f,  ( r, ) dt 


dgi2  (r, , r2) 

dr% 

± 


K^i2  (-^1'  -^2)  - d.  (rj)  ^2-^2  (-^^2) 
- ^2  (r2)  (r^) 


(3.8) 
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Also,  for  pairs  of  jobs  in  priority  classes  1 and  3,  we  have: 

r^,  t+dt)  = (r^+dr,  r^,  t)  (1  -X^dt) 

+ h,  (r, , t)  (r^)  dt 

+ hj  (rj,  t)  (rj)  dt 


dg„  (r^,  r,) 

dri 


- (-^3)  ^1-^1  (-^1) 


(3.9) 


When  the  2-job  and  3-job  are  present,  we  have  the 
differential  equation: 


r^,  t+dt)  ^ g^^(r^  + dr , r^,  t)  (\-X^dt) 

+ hj  (rj,  t)  A.3^3  (r3)  dt 
+ hj(r^,  t)  (rj)  dt 

- U323  (0,  r^,  r^,  t)  dt 


dg23  (r^,  r3) 

dr^ 


(r2r3)  - *2  (r^)  X^f^  (r^) 

- {r^  )X  2^2  (^2)  - U323  (0,  r2,  r3) 


(3.10) 


Finally,  for  states  where  jobs  of  all  three  classes 
coexist,  we  have: 


^^123  ^2,  r^,  t+dt)  = U^23  ^2'  ^3'  t) 

+ g^2  (rj+dr,  r2,  t)  X^f^  {r^)  dt 
+ gj3  (rj+dr,  r3,  t)  X.2T2  (-2^2) 

+ g23  {r^  + dr,  r^,  t)X^f^{r^)  dt 


^^123  ( -^1  ' -^2  / -^3  ) 


dr. 


- 9^13 


- 5^23  (^2/ 


-^2  ) ^3-^3  ^ -^3  ) 

r3)  ^2-^2  (-^2) 
r^)  X^f^  (rj) 


(3.11) 
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As  expected  from  observing  the  previous  model,  the 
differential  equation  for  Uj23(’  , ’ , ■ ) is  defined  by  arrivals 
from  the  states  having  two  jobs  present. 

Since  the  expected  service  time  must  be  finite,  the 
boundary  conditions  for  this  M/G/1/3/3/1  system  are: 


him 


hj  (r^)  = 0; 


i=l, 2, 3 


=0, 


1 

Lim 


r ^ ^ i j 


g,^(r,,  r.)  =0; 


i=l,2  i<j<3 

i=l,2  i<j<3 


Lim 

r ^ — >cx5  ^12  3 ' “^1  ' 


r^,  r^)  =0; 


2=1, 2, 3 


Similar  to  the  discussion  on  the  M/G/1/2/2/1  case,  one 
can  obtain  an  expression  for  all  gij(0,-)  that  will  allow  this 
set  of  differential  equations  to  be  solved  sequentially. 
These  expressions  follow  in  Propositions  2,3  and  4. 


Proposition  2 . For  the  M/G/1/3/3/1  system 


gi2(0,r2)=  (r.)  dr 


J 

r,=0 


oo 

r 


-X. 


+ (r^)  h.  (r, ) e'^^^'dr, 


J 

r,=0 


It  can  be  observed  that  Proposition  2 and  Proposition  3 
have  the  same  form  in  that  each  term  consists  of  the 
probability  of  a job  for  that  state  arriving,  multiplied  by 
the  probability  of  no  arrival  of  the  job  that  would  cause  the 
system  to  make  a transition  to  a different  state. 
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Since  the  expected  service  time  must  be  finite,  the 
boundary  conditions  for  this  M/G/1/3/3/1  system  are: 


him  . , 

h . ( rj ) - 0 ; 

i=l, 2, 3 

r.)  =0, 

i = l , 2 i<  j<3 

rj-eoo  - 0 / 

i=l,2  i<j<3 

Lim 

r^-^oo  ^12  3 ( ' ^2'  -^3 ) 

=0;  i=l,2,3 

Similar  to  the  discussion  on  the  M/G/1/2/2/1  case,  one 
can  obtain  an  expression  for  all  gij(0,*)  that  will  allow  this 
set  of  differential  equations  to  be  solved  sequentially. 
These  expressions  follow  in  Propositions  2,3  and  4. 


Proposition  2 . For  the  M/G/1/3/3/1  system 


r 


(0^  = h,(r,)X,  f,  (r,) 


•2  \ 2 ' '''1 


J 

n=o 


1 


+ (r^)  r hj  (r^) 


J 

n=o 


It  can  be  observed  that  Proposition  2 and  Proposition  3 
have  the  same  form  in  that  each  term  consists  of  tlie 
probability  of  a job  for  that  state  arriving,  multiplied  by 
the  probability  of  no  arrival  of  the  job  that  would  cause  the 
system  to  make  a transition  to  a different  state. 
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Proposition  3.  For  the  M/G/1/3/3/1  system: 


J 


0 


This  is  not  the  case  in  Proposition  4 since  the  only  job 
that  may  arrive  to  move  the  system  into  another  state  is  the 
1-job.  Because  this  job  will  be  served  before  any  of  the 
others,  its  arrival  (and  subsequent  service  completion)  does 
not  affect  the  value  of  g23(0,r3). 


Proposition  4 . For  the  M/G/1/3/3/1  system: 


j 

0 


Proposition  5 . For  the  M/G/1/3/3/1  system: 


OO 


r 


u {0 , r^,  r^)  = g^^{r^,r^)  X,f^(r^)dr^ 


J 


0 


OO 


r 


+ g^^{r^,  r^)X^f^{r^)  dr^ 

J 


0 


The  differential  equations  representing  the  state  space 


variables  of  the  M/G/1/3/3/1  model  are  summarized  as 
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= (?ii+?i3)  *2  (rj)  - g.^2(0 , r^)  - Pf^X^f^ir^) 

- ( A.J  +X-2  ) 7I3  ( iTj  ) - 5^33  ( 0 , JTj  )-  P22  (0  , ~ Pf^2^-i  ( -^3  ) 


dh,  (r^) 

d?7~ 
dh2  (r2> 

d-t'2 

dh3  (r3) 
dr3 

dgi2  (rj,  r2) 

dgi3(r3,r3) 

dr, 

X 

dg..  {r^,  r-.)  . 

“ ^i9^23  (^2^3)  “ ^2  (-^2)  ^3^3  (^3)  ~ -^3  (-^3)  ^2-^2  (-^2) 


= ^39^12  ^2)  - ^1  (^1)  ?^2^2  (^2)  - *2  (^2)  (^1) 

• ~ ^29^13  ^3)  “ ^1  (^1)  ^3^3  (-^3)  ~ -^3  (^3)  ^1-^1  (-^1) 


u.  2 3 ( 0 , f iT^  ) 


2'  -^3 


^ ^ ! 2 3 ^ "^1  ' ■^2  r ^ 


2'  -^3 


dr^ 


9^12  ( -^1  A ^2  ) ^3^3  ^ ^3  ) gi  3 ( -Z^i  , 2*3  ) X,2-f2  (-^2^ 


9^2  3 ( -^2  ' ^3  ) ^1-^1  ( ^1  ) 


In  the  following  section,  the  expressions  obtained  for 
the  previous  two  models  will  be  generalized  for  the  case  where 
there  are  n priority  classes. 

n-Class  Case:  M/G/l/n/n/1  Model 

From  the  result  in  the  previous  sections,  the 
differential  equations  that  define  the  steady— state  density 
functions  for  the  model  with  general  n priority  classes  can  be 
deduced.  As  with  all  models  addressed  in  this  dissertation, 
all  priority  classes  all  have  population  sizes  of  one.  For 
convenience,  the  job  in  priority  class  j is  referred  to  as  the 
j-job. 
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With  these  density  functions  and  the  corresponding 
boundary  conditions,  the  entire  system  can  be  defined  and 
solved  as  a set  of  sequential  differential  equations. 

Consider  the  following  definitions.  Let  the  entire  state 
space  be  divided  into  2"  mutually  exclusive  subspaces,  where 
n is  the  total  number  of  priority  classes.  Let  the  subspaces 
which  are  generated  by  the  introduction  of  a j-job  be  a 
combination  of  the  subspaces  defined  by  the  introduction  of 
the  (j-l)-job.  Using  this  approach,  we  can  number  the 
subspaces  sequentially  starting  with  subspace  0 which  is  the 
idle  state  of  the  server  (none  of  the  n jobs  are  present)  . 
This  ordering  is  called  lexicographic  ordering.  Table  3.1 
shows  this  numbering  system  for  n equal  to  3. 

The  indices  associated  with  subspace  k are  the  jobs  that 
are  present  in  that  subspace.  That  is,  if  j is  a member  of  the 
index  set  0,^,  than  the  j-job  is  present  in  subspace  k. 

Let  us  also  define  the  following  sets 

0:  {l,  2,  . . . , n)--full  set  of  indicias 

set  of  indicias  associated  with  subspace  k 

In  addition,  let  the  scalar  A associated  with  the  index 
set  be  defined  as 

At,  : ^ 

' ie*. 
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Table  3.1  Numbering  of  Subspaces 


Subspace 

Number 

Number  of  Jobs 
Dimension  of 
Subspace 

Jobs 

Present 

1 

0 

0 

2 

1 

1 

3 

1 

2 

4 

2 

1,2 

5 

1 

3 

6 

2 

1,3 

7 

2 

2,3 

8 

3 

1,2,3 

We  now  define  a general  form  for  the  differential 
equation  for  the  joint  density  function  of  any  subspace  k when 
n priority  classes  exist. 


Result  1 . 

For  the  M/ G/ 1 / n/ n/ 1 models  the  differential  equation 
representing  the  density  function  of  the  state-space 
variables  for  subspace  k is  given  by: 


dU^  (•) 


i j<i 


where  i=  min{l  : 1 e 

V(*)  : density  functions  corresponding  to  subspaces 
with  one  more  dimension  (job)  than  subspace  k,  and 
g(*)  : density  functions  corresponding  to  subspaces 
with  one  less  dimension  (job)  than  subspace  k. 


Result  1 shows  that  there  are  three  terms  that  form  any 
of  the  defining  differential  equations.  The  first  describes 
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the  system  remaining  in  subspace  k if  there  are  no  arrivals. 
The  second  term  defines  a transition  from  a subspace  that  has 
one  job  less  that  subspace  k,  that  job  being  a j-job.  Thus, 
an  arrival  of  a j-job  when  the  system  is  in  that  subspace  will 
cause  a transition  to  subspace  k.  The  third  term  refers  to 
the  situation  that  occurs  if  the  system  is  in  a subspace  that 
has  all  of  the  jobs  of  subspace  k with  the  addition  of  one 
job,  a j-job,  that  has  a higher  priority  than  all  of  those  in 
subspace  k and  whose  serviced  is  just  about  completed.  After 
the  completion  of  the  j-job,  since  all  of  the  remaining  jobs 
are  those  that  define  subspace  k,  the  system  will  naturally 
move  into  subspace  k. 

As  noted.  Result  1 is  valid  for  all  values  of  k with  the 
convention  that 

where  Po  is  the  probability  of  the  server  is  idle  (no  jobs 
being  served  or  in  the  queue) . 

In  addition  to  Result  1,  we  can  define  the  general  form 

of  U(0,‘)  for  all  density  functions.  This  is  given  in  Result 

2 . 

Result  2 . 


For  the  M/ G/ 1 / n/ n/ 1 model, 


- 5T  X.r 


where  all  of  the  symbols  are  as  defined  for  Result  1. 
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Result  2 describes  the  transitions  that  will  cause  the 
system  to  be  in  a state  U(0,-)  where  the  highest  priority  job 
in  that  state,  the  i-job,  is  just  completing  service.  Since 
the  service  of  the  i-job  is  not  affected  by  the  arrival  of 
lower  priority  jobs  (any  j-job  can  arrive  during  the  servicing 
of  the  i-job)  provided  the  system  was  in  a state  V(-)  where 
all  of  the  jobs  in  subspace  k except  the  j-job  were  present 
before  that  arrival.  Therefore,  the  arrival  of  that  j-job 
will  cause  a transition  into  subspace  k. 

The  only  other  concern  that  must  be  acknowledged  is  that 
in  order  for  the  system  to  remain  in  subspace  k until  the 
completion  of  the  i-job,  there  must  be  no  arrival  of  jobs  that 
do  not  belong  in  subspace  k,  i.e.  that  will  cause  a transition 
out  of  subspace  k,  during  the  entire  service  time  r^^  of  the  i- 
job . 


Performance  Measures 

We  now  calculate  performance  measures  for  the  continuous- 
time continuous— state  models.  We  can  use  the  normalizing 
equation  to  get  the  value  of  the  probability  that  the  system 
is  idle. 


>1 


Po  = 


J 


In  order  to  find  the 


either  preempted  or  waiting 


a renewal  process . Let  the 


(3.12) 

probabilities  of  the  j-job  being 
for  initial  service,  we  consider 
cycle-time  of  the  j-job,  Y‘^’,  be 
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the  time  between  sequential  arrivals  (or  sequential 
completions)  of  the  j-job.  This  is  made  up  of  periods  during 
which  the  j-job  is  waiting  for  initial  service,  in  service, 
preempted,  or  waiting  to  arrive  to  the  queue.  The  expected 
value  of  is  the  sum  of  the  expected  completion  time  of  the 
j-job  and  the  expected  interarrival  time  of  the  j-job.  The 


probability  that  the  server  is  occupied  by  the  i-job  is 


P[i-job  in  Service]  = ——I!—  = (p,  Vi  (3.13) 

Therefore,  the  probability  that  the  server  is  idle,  when 
the  j-job  has  the  lowest  priority  in  that  subspace,  can  be 
given  by 


P [ Server  Idle]  = 1-12  ^ ^ ^ = l-  i(p,  (3.14) 

The  completion  time,  which  is  the  cycle  time  excluding 
the  interarrival  time,  has  expectation 


E[T^,„]=E[Y^^n 


(3 . 15) 


The  expected  in-process  waiting  time  for  the  j-job  is 
dependent  on  the  expected  number  of  preemptions  by  any  i-job 
(i<j),  and  can  be  calculated  by  summing  the  integration  of  the 
density  functions  associated  with  the  subspaces  in  which  that 
j-job  is  preempted.  For  the  model  with  exponential  service- 
time distributions,  the  Markov  model  approach  is  used  as 
described  in  the  following  section. 
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The  busy  period  (given  that  the  j-job  is  preempted) 
started  by  the  arrival  of  an  i-job,  starts  with  the 

arrival  of  an  i-job  and  ends  when  the  server  is  free  to  begin 
service  on  the  j-job. 

In  order  to  calculate  the  expected  value  of  for  any 

i<j,  we  first  consider  the  expected  completion  time  of  job  i, 
and  the  arrival  of  any  jobs  during  that  completion  time.  Jobs 
of  higher  priority  will  already  be  accounted  for  in  the 
completion  time;  however,  jobs  with  priority  lower  than 
the  i-job,  but  higher  than  the  j-job,  will  wait  to  begin 
service  after  the  i-job  is  completed.  These  lower  priority 
jobs  then  elongate  the  busy  periods. 

Let  be  the  set  of  indices  of  jobs  with  priorities 

between  i and  j,  i.e.  { i + 1 , . . . , j-1 } . This  set  has 
subsets;  let  be  the  subset  (k  = 1,  ..,2^“^“^  ) of 

with  a maximum  index  m^.  Thus,  we  can  write  the  busy  period 
(with  respect  to  the  j-job)  that  is  started  by  the  arrival  of 
an  i-job  is 


E[B.^^]=E[T^,,,]  + 


n <1® 


(3.16) 


Since  the  expected  virtual  service  time  is 
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E[T^y.]=E[T^,„]+E[T^,„]  = 

1-Ep, 

1-1 

the  expected  initial  waiting  time  as 
E[T„,„]=E[T,,„]-E[T,u,] 


(3.17) 


(3.18) 


Since  the  j-job  can  be  preempted,  its  effective  arrival 
rate  is  affected  by  its  expected  completion  time  which  must  be 
added  to  1/A.j,  its  expected  interarrival  time,  to  get  the 
expected  virtual  interarrival  time.  The  inverse  of  this  is 
the  virtual  arrival  rate. 


X 


vO»  — 


1 


E [ ] + 


1 

XT7) 


1 


(3.19) 


The  delay  factor,  as  defined  earlier  in  this  chapter,  is 
given  by 

^(,)^  +E[T„,„]  _ E[Y‘J>] 

E [ ] E [ r ] 

where  Tg,j,  is  the  service  time  of  the  j-job. 

The  probability  that  the  j-job  is  preempted  or  has 
arrived  but  has  not  started  service  (initial  waiting) , can  be 
expressed  as  the  proportion  of  j-jobs  entire  cycle  during 
which  this  occurs. 


P[XeWo  ] = 


E[  ] 


(3.21) 
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Similarly^  we  have  the  probability  that  the  j-job  is  in 
the  system  and  has  started  service  is  given  by 


P[X€S^J’]  = 


E [ T^u,  ] 

E[  ] 


(3.22) 


and,  the  probability  that  the  j-job  is  in  in-process  waiting 
time  can  be  written  as 


P[XGW^^^]  = llIalL  (3.23) 

E[  ] 

The  probability  that  the  j-job  is  waiting  either  initially, 
before  it  starts  service,  or  when  preempted  is  given  by 

(3.24) 

Ti^  = P[XePi^<J>  ] + P[XePi7o‘^’] 


Exponentially  Distributed  Service  Times 
Let  us  now  consider  the  service-time  density  functions 
for  priority  class  i be  defined  as: 

(t)  =a^e'“'%  Vi 

As  will  be  demonstrated  in  the  following  sections,  the 
defining  differential  equations  for  these  models  will  all  be 
of  the  form 


dh,  (r,) 


i ' i 

dT^ 


= A.h.  (r.)  - 


The  solution  for  differential  equations  of  this  form  (see 


Appendix  A)  is  given  by 
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h,  (r,) 


(3.25) 


2-CIass  Case:  M/M/1/2/2/1 
Density  functions 

The  general  defining  differential  equations  for  the 
M/G/1/2/2/1,  are  given  as 


dh,  ( r, ) - . 

(r,)  - (^i) 


dh^  ( ) 


dr. 


J 
t=0 


dgi2  (r^,  rj) 




= -hj  (rj)  A.2^2  (r2)  - *2  (r2)  (r^) 


The  differential  equations  for  this  model  can  be  found  by 
substituting  the  expressions  for  fj  (r^)  and  f2(r2)  into  the 
above  equations. 


dh,  ( r, ) , . „ ^ 

— ^2hi  (r^) 


r 


dh^  ( ) 


dr. 


^2^2 


r 


Po+  h^ipjdr^ 


V 


J 

0 


o 


y 


dgj2  (r, , r,) 


dr. 


= -hj  (rj)  ^20t2e'“""'"-  h,  (r,)  e'"’''’ 


2 V 2 / 


The  boundary  conditions  for  this  model  are 
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Lim  , , , ^ 

^ — )oo  -^1 


^ n Lim  , , ^ 

g(-!^i/ r^)  =0,  ^ _g(r,,rj)=0 


Using  the  boundary  conditions,  the  defining  differential 
equations,  and  Proposition  2,  we  have 


h,(r,)  =££^e-“'"- 


CX|  +i^2 


hj  (r2)  =Po?^2 


ttj  +^2  ^ 

0C-, 

V ^ ^ y 


_ Po^l^2 

12  -1'-2''U'-2 


g,2  (r,,  r,)  = 


(a,  +a,+?i,  +>.,) 


'1  •''2 


(3.26) 

(3.27) 
(3.28) 


Now  that  we  have  closed-form  expressions  for  each  of  the 
density  functions  describing  the  M/M/1/2/2/1  model,  we  can 
calculate  Pq,  the  proportion  of  time  that  the  system  is  idle. 
For  the  continuous-time  continuous-state  M/M/1/2/2/1  model, 
the  normalizing  equation  is 


Po  + 


h,  it)  dt+  fh,  ( t)  dt  + 


0 


J 

0 


0 0 


t J dt.  dt.  = 1 


therefore 


Po  = 


a^a2  (a^+>i2) 


V 


OC1OC2  ( cx^ +X-2  + A,2  ) +cx^A^2  ( oc^  + + ^2 ) +A*^A»2  ( oc^ +0C2  + “H A^2  ) 


\ 


/ 


(3.29) 


which  completes  the  evaluation  of  the  steady  state  density 


functions . 
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Performance  measures 

Using  equations  3.26  through  3.29,  we  now  proceed  to 
calculate  the  performance  measures  as  defined  earlier  in  this 
chapter . 

Firstly,  since  the  interarrival  time  distributions  are 
exponential,  the  expected  duration  of  the  idle  time  of  the 
server  is 

1 

E[Duration  of  the  Idle  Period]  = (3.30) 

A,,  + A^2 

The  probability  that  the  1-job  is  present  alone  in  the  system 
is 


r p X 

P [ 1 - job  Alone  in  System]  = h.  (rj  dr.  = ^ (3.31) 

J oTTXr 

0 12 

and  the  probability  that  the  2-job  is  present  alone  in  the 
system  is 


P [2- job  Alone  in  System]  = 


OO 


r 


0 


Po'^2 

CXi  + A-2 

(3.32) 


In  order  to  calculate  the  probability  that  the  2-job  is 
preempted,  it  is  necessary  to  calculate  the  expected  cycle 
times,  and  Y*^’.  Using  the  expression  calculated  for 

models  with  general  service  time  distributions,  Y*^’  and  Y*^’ 
can  be  written  as 


£[  ] 


1 1 


(3.33) 
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(3.34) 


The  proportion  of  time  that  the  server  spends  serving  the  1- 
job  is  given  as 


£[Ts<i,  ] 1/a,  X, 

" l/k,+l/a,~  '^+1,  (3.35) 

The  expected  virtual  service  time  is  the  sum  of  the  expected 
in-process  time  and  the  expected  service  time. 


E [ ] 

i-Pi 


cc^ 


(3.36) 


The  expected  in— process  waiting  time  is  written  as 


E[T„,,,]  = ?,^E[T^,„]E[B^^2]  = E[T^,.]  ^ 


(3.37) 


In  order  to  calculate  the  initial  waiting  time  a Markov 
Model  is  used  to  represent  the  M/M/1/2/2/1  model,  this  model 
will  have  four  states  that  can  be  numbered  as  outlined  in 
Table  3.1.  Figure  3.3  shows  the  Markov  model  representation 
of  the  M/M/1/2/2/1  model. 

The  steady-state  probabilities  are 


a,a,  (a.  +Xj 

7X  — i t * z 

(dj+A^)  [ (a^+Aj)  (a,+X^)  h-AiAJ 

jj-  _ aj^a2X,j 

(dj+A,,)  [ (a2+A2)  (a^+Aj)  +/.2A2] 
(dj+Aj)  [ (a^+x])  (dj+Aj)  +A1A.2] 


(3 . 38) 

(3.39) 


(3.40) 


^1^2  ( ^ 

(a^+Aj  [ (a^-^X^)  + K^k^] 


(3.41) 


K 


{1,2} 


We  can  now  calculate  the  expected  initial  waiting  time  by 
multiplying  the  first-passage  time  from  state  4 (2-job 
waiting)  to  state  2 (2-job  waiting)  by  the  probability  of  a 2- 
job  arrival  having  to  wait  (given  a 1-job  is  present) . This 
is  given  as 


” a,  ' 


(a,+>.i)  [ (a^+A.^)  (tti+Aj)  +X^A.2] 


(3.42) 


The  expected  completion  time  of  the  2— job  is  given  by 


E [ ]=E[  ]+E[  ] 

+ (3.43) 

(a^  + ^^)  [ (a^  + A.2)  {0.2  + X2) 

which  the  allows  us  to  write  the  expected  cycle-time  of  the  2- 
job  as 

E[  ] = CL^X-i^ 

(a^  + \)  [ (a^  + A.^')  (0.2  + X2)  +A^/.2] 

^ 1 ^ (3.44) 

The  virtual  arrival  rate  of  the  2-job  is  the  inverse  of 
the  cycle  time 

1 <2)  _ 1 

V 


y (2) 


(3.45) 
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The  delay  factor  of  the  2-job  gives  the  ratio  of  the  time 
the  2-job  spends  waiting  in  the  system  to  the  service  time  of 
the  2- job.  That  is 

_ x,X2(X,  + X2+a,) -X,a,a, 

~ ETT;;n  " ^ ’ 

The  probability  that  the  2-job  is  being  serviced,  or  that 
the  2- job  is  in  a given  state  can  be 

calculated  using  equations  3.13,  3.22,  3.23,  3.24. 

The  proportion  of  time  the  server  is  occupied  serving  the 
2-job  can  be  written  as 


9 


£[  r<2)  ] 


(3.47) 


where  E[Y*^’]  is  given  in  equation  3.44. 

Graphs  of  these  performance  measures  are  shown  in  Figures 
3.5  to  3.13.  These  graphs  are  for  the  following  fixed  values; 
the  remaining  service  times,  ri=r2=0.5;  and  the  expected 
service  times,  aj=a2=0.5.  For  graphing  purposes,  a is  used 
instead  of  a because  of  font  limitations  in  the  graphing 
package . 


3-Class  Case;  M/M/1/3/3/1 
Density  functions 

As  before,  using  the  differential  equations  derived  for 
the  M/G/1/3/3/1  model  and  substituting  f^  (rj^)  into  those 
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equations  results  in  the  corresponding  differential  equations 
for  this  model . 


dh,  (r,) 

— j — - (A,2  + A,3)  ( r^ ) - PqX-^(X-^b 


-“in 


dh^  ( ) 


dr. 


= (Xi+  X^)  (r^)  - ^12  (0,  r^)  - 


dhj  (rj) 

3r% 


= (A.J+ X.^)  hj  (Tj)  - (0,  rj) 

“ 5^23^®'  -^3^  ~ Po^3^3^ 


dgj2  (r, , r,) 


dr, 


= X,3gi2  (r^,  rj)  -Pp  (p3X.2a2+  P2X.1CX3) 


,) 


dgj3  (r,,  r3> 
dri 


= X.2gj3  (r^,  rj)  -pp  (p3X.3a3+  P3X.3a3)  e' 


dg23  (r2,  rj) 

dr. 


= -P 


0 


P2^3^3'*”  P3^2^2~*’ 


V 


Pl2^3^3‘*"  Pl3^2^: 


y 


-(o^rj+o^r^) 


-p^(p^,X,a,  + p,,X,a,  + p2,\a,) 


In  order  to  solve  these  equations  simultaneously , 
extensions  to  Propositions  2,  3,  4 and  5 are  needed.  These 
can  be  written  as 


oo 

r 


gi2  (0,  r^)  = — ^4-^2  (-^2)  + X.2a2e'“=''Mh3  (r^)  e'^>'''dr 

(X,  + A.  J 

13  0 


q^3  ( 0 , r3 ) - 


^1^1 

oc,  + X. 


00 

r 


hj  (t3)  + X,3a3e‘“’''>  h,  (r, ) e^^^'-dr, 


-X. 


.y 

0 


00 

P23  (0,  r3)  = X,2h3  (rp)  + X^a^e''^’’'nh2  {r^)  dr. 


0 
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u 


OO 

123  (0,  r2,  rj)  = ^.1^23  (r^,  r^)  + (-^i/  -^2) 

0 


+ 


?l2a2e'"="'=Jgi3  (rj,  rj)  dr, 

0 


The  density  functions  from  these  defining  differential 
equations  can  thus  be  written  as 


hi  (ri)  = where  Pi  = 


^lOti 


A2  + A3  + (Xi 


(3.48) 


, / V -a.r  A,,CX,  ( p,  + CX,  + X.-,)  _ „ 

^2  (^2)  =Pop2e  ^ h Wherep2=^_ .-■■■.  ? i ' — j (3.49) 

( CX.2  + ^3 ) ( OC^  + ^3)  “ 


r 


h^(r^)=  where  p3  = 


A.3OC3 


1 + 


Pi  . P 


\ 


V 


aTTTZ^  a 

^ 

A,  - ,.  a. 

^ A.2 


(3.50) 


J 


P3A,2CX2+  P2^^0C3 


Pi2  (ri,  r2)  = where  p^2=  r.--i-i  (3^51) 


A,3+  OC3 


q„  (r,,  rj)  = PoP.je"”’'-'*”-"'’ , where  p.,=  p3^.« 


A2  + CCj 


(3.52) 


9^23  (^2/  ^3)  = Pop23e'‘'^^'^“’^’’ 


where  p 


1 


23 


a. 


'p,X,a,*  P.»^=°^  ' 


V 


(3.53) 


J 


u{r^,r^,rj)  = p^Pi23e‘‘“''''*“=''=*“’^'’ 


where  p 


_ Pl2^3^3  P 13^2^2  P2 3^1^] 


123 


a. 


(3.54) 
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Performance  measures 

The  proportion  of  time  that  the  system  is  idle,  Po,  is 
found  by  using  the  normalizing  equation. 

Po=  jl + ^ ^ ^ Pl23  V (3.55) 

[ ttj  ttj  ttj  a^tt2  aja3  a^a.^  a^a^aj\ 

The  expected  duration  of  this  idle  time  is 


^[Duration  of  the  Idle  Pori nd] = (3.56) 

The  probability  that  a particular  j-job  is  alone  in  the  system 
can  be  written  as 


r 


P[l- job  Alone]  = h^(r^)dr^  = 


Po'^i 


J 

0 


A.  2 ^ 3 


oo 

P [2 -job  Alone]  = fh2(r2)dr2= 

{ cc 


P0P2 
2 


r 


P [3- job  Alone]  = (r^)  dr^- 


j 

0 


Pop 

a. 


(3.57) 


(3.58) 


(3.59) 


In  order  to  calculate  other  performance  measures  of  interest, 
the  expected  cycle  time  of  the  1-job,  2-job  and  3-job  (Y*^’, 
and  Y‘^*),  along  with  the  completion  times,  Tc,j)  need  to  be 
calculated . 


P[r^,„]  = E[  Y'^'M 


(3 . 60) 


Since  the  1-job  and  2-job  are  unaffected  by  the  3-job, 
the  values  of  E[Y^^’],  E[Y*^’],  9'^’,  9*^’,  d‘^'  and  d‘^’  are  the 

same  for  this  model  as  for  the  M/M/1/2/2/1  model.  As  with  the 
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M/M/1/2/2/1  model,  in  order  to  find  E[Y‘^*],  E[T„<^>]  and  E[T„q‘^’] 
must  be  found. 

The  expected  in-process  waiting  time  can  be  written  as 


E [ T„,„  ] = £ [ T,,.,  ] - £ [ ] = £ [ T^.3,  ] - 


1 


a 


(3.61) 


where  the  expected  virtual  service  time  is  given  as 


£[T,„.]= 


l-9i-(p2 


(3 . 62) 


Thus  the  in-process  waiting  time  is 


E [ ] = 


1 

(Pl  + (P2 

OC3 

_l-(Pl-(P2 

(3.63) 


Using  the  Markov  model  for  the  M/M/1/3/3/1  model  the 
expected  initial  waiting  time  can  be  calculated  by  first 
calculating  the  steady-state  probabilities.  The  balance  of 
flow  equations  for  this  model  can  be  written  as 


( -I- OC2  ) 7C|2)—  ^1^(1  ^ 2}'*'  ^2^0 

( X3-I-OC3  ) 71^  2}~ 

(A.2  + C)C^)  ^{1^3}=  ^1^(3} 

(A,^  + X,2  + (X3)  K^2)~  ^1^{1,3}'^  ^2 ^{2,  3} 

(^1  '‘’^2)  ^{2,3}~  ^3^(2} 2, 3}“*"  ^2^(3} 
^{1,2,3}“  ^3^{1,2}'^  ^2^{1,3}^  ^1^{2,3} 

The  normalizing  equation  is 
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8 

Eti*  = 1 

1=1 


Therefore,  for  the  8 states  in  this  model,  i = l,  ..8,  can 

be  written  as 


^1 

1 ■ ^ ' ''■3 


^p  — i-i  I 0-1 


X2c^  + X,^c. 


^U,2}~  ^12^{  }'  ^12“  ^ .1 

a^  + ^3 


^3 

7C{3)-  C3  - _ ( 1 + + C2  + C^2  ) 


^{1,3}  ^13^{}'  ^13“ 


X^i  C3  + 

A»2  +CX3 


^(2,3)  ^2  3^{}'  ^2  3“ 


^2  (^13‘^^3)  *^^3  (^2“^^12) 


a= 


^{1,2,3}  ^123^{}'  ^123“ 


^1^23'^^2^13"*'  ^3^ 


12 


7T|j  ( 1 + j + 7T|2)  + ^ 2}  ^{3}  ^{1 , 3}  ^{2 , 3}  ^{1 , 2 , 3)  ^ 


-1 


(3.64) 

(3.65) 

(3.66) 

(3.67) 

(3.68) 

(3.69) 

(3.70) 

(3.71) 


Next^  the  expected  first  passage  times  when  the  3-job  has 
to  wait  are  calculated.  These  are  the  first-passage  times 
from  states  {1,3},  {2,3}  and  {1,2,3}  to  {3};  that  is  the  time 
until  a waiting  3- job  starts  service. 


^{1, 3M3)“ 


a^a2  + ?i2  (a^  +a2+?i^  ) 
o^ocT^aT+X^l 


^{2,3M3}~ 


oCi 


(3.72) 

(3.73) 
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(X,  +0C2 

^{1,2,  3M3}~ (3.74) 

Thus  the  expected  initial  waiting  time  can  be  written  as 

“ ^{1)^(1, 3M3)"''  ^(2)^(2, 3M3)'*'  ^{1,2)^U, 2, 3M3)  (3.75) 


Using  these  results,  we  can  find  the  proportion  of  time 
spent  serving  the  3- job  (pj . This  can  be  expressed  as 


E[  _ l/a3 

~ i/a^+i/J^,+E[T^n,\  +£[r„,„] 


(3.76) 


The  expected  busy  periods  are 


= £[r^a,]  = = J_ 

tti 

E[B^^^]=  E[T^.,]  +£[53/3] 

£[53/3]  = E[r^,„] 

The  probability  that  a 3-job  is  preempted  (in  W‘^’),  in  3^'^’, 
or  in  Wq‘^’  can  now  be  calculated  as 


P[Xe  ] = 

E [ r„„,  ] 

(3.77) 

£[  Y<^>  ] 

P [ Xe  S^,3,  ] = 

(3.78) 

E[  Y<^>  ] 

P[Xs  = 

E [ r^,3,  ] 

(3.79) 

£;[  y(3)  ] 

The  virtual  arrival  rates  for  the  3-job  are  the  inverses 
of  the  expected  cycle  times  of  the  3- job. 


1 

y (3) 
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(3) 

y 


(3.80) 


The  delay  factors  for  the  3-job  can  thus  be  calculated  as 
d<3>=  (E[T„.,]  +E[T„,,,])a,  (3.81) 

Graphs  of  these  performance  measures  are  shown  in  Figures 
3.13  to  3.28.  These  graphs  are  for  the  following  fixed 
values:  the  remaining  service  times,  ri=r2=r3=0 . 5 / the 

expected  service  times,  ai=a2=a3=0 . 5;  and  the  3- job  arrival 
rate  ^3=0.5.  The  3- job  arrival  rate  is  not  varied  since  the 
1-job  and  the  2- job  are  unaffected  by  the  3- job.  For  graphing 
purposes,  a is  used  instead  of  oc  because  of  font  limitations 
in  the  graphing  package . 


n-Class  Model:  M/M/l/n/n/1 
Density  functions 

The  general  form  of  the  density  functions  associated  with 
this  model  can  be  derived  by  using  Result  1 and  Result  2 as 
specified  for  the  M/G/l/n/n/1  model.  For  a particular 
subspace  0,^,  the  density  function  for  the  n priority  class 
model,  u,„),  can  be  written  as  equation  3.82.  This  gives  a 
simple  form  of  the  equation  of  the  density  function;  for 
example,  expanding  this  formula  for  the  density  function 
h3"’ (r^)  , we  get  equation  3.83. 
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(. ) = Pop*:  e 


where 


p*. 
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r 

i. 


y P^JjOlOMj) 

m<i  Cf  _|_  A 


\ 


T 


a;."’- 


E 
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fY  4- A 


+ a 


y 


(3.82) 


y 


(^;)  = Pop 


oKr’e-“’^' 


where  pj"’ 


i-E 


p; 


in) 


\ 


in) 


\. 


Kj  a^  + 


n 


k;'  - y, 


+ a 


j 


(3.83) 


Performance  measures 

Using  the  density  functions  as  described  by  equation 
3.81,  we  can  calculate  the  probability  that  a given  j-job  is 
in  the  system  alone  as 

n Q ^ 

P[  j- Job  Alone  in  the  System]  = (3.84) 

a, 

Having  found  the  solution  for  the  M/M/ 1 /n-1 /n-1 / 1 model, 
we  can  proceed  to  solve  for  the  performance  measures  for  the 
M/M/l/n/n/1  model  recursively.  The  proportion  of  time  the  i- 
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job  spends  being  served,  and  the  proportion  of  time  it  spends 
waiting  (either  initially  or  preempted)  can  be  written  as 

^ _ i/x, 

' l/a^  + l/K^+ElT„u,\  +E[T„.„]  (3.85) 

d<^>=  (E[T„u,]  +£[T„.„]  )a,  (3.86) 

We  can  calculate  the  expected  in— process  waiting  time  can  be 
written  as 


E[T„.„]  =E[T,,.,]  - 


1 


l/a^ 

TTi — 

i-E(pj 

>1 


(3 . 87) 


In  order  to  calculate  the  expected  initial  waiting  time 
we  use  a Marlcov  model.  Let  the  2"  states  of  the  M/M/l/n/n/1 
model  be  numbered  such  that  the  first  2"'^  states  are  all  the 
combinations  of  the  jobs  l,...,n— 1.  Also,  let  states  2"~^  + l, 
2"“^+2,  . . . , 2"  contain  the  jobs  in  states  1,2,  . . . , 2'’”^  in  addition 
to  the  n-job.  For  example,  the  states  for  the  M/M/1/2/2/1 
model  are  given  in  Table  3.1  as  subspaces  1 through  4,  and  the 
states  for  the  M/M/1/3/3/1  model  are  subspaces  1 through  8 of 
the  same  table. 

Using  this  numbering  sequence,  let  Q*"*  be  the  one  step 
transition  rate  matrix  for  the  M/M/l/n/n/1  model.  Also  let 
this  matrix  be  made  up  of  the  submatrices  A'"’  and  which 


are  defined  as 
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A*"’  + A<”> 


la/”’  a/"’ 

lAi”’  a/”’ 


+ 


5/ 


(n) 


0 


0 

5/”’ 


0 0 


0 

0 


(n) 


Let  US  also  define  the  following  scalar 


(3.88) 


A<”>=  tX, 

j=i  ^ 

The  diagonal  element  of  corresponding  to  state  k can  be 

written  as 


6/"’ = - [A<"’ -EA,j+a_j]  , i=  niin{ie<|)^ 

We  can  thus  write  the  four  submatrices  of  A*”’  as 


a/'”  = A<”-^> 


1 


oc^  0 0 

0 0 •••  0 


A/”’  = A<"-1> 


0 0 0 


where  the  4x4  matrix  is 
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0 : ^2  0 

M-l  0 : 0 ?l2 

71  (2)  _ 

•••  •••  •••  •••  ••• 

M-1  0 : 0 

0 0 : |i^  0 

Having  defined  the  rate  transition  matrix,  Q<">,  we  can  break 
them  into  submatricies  02*"’,  Qa*"’  and  Q/"’ . 


Q 


(n)  _ 


or  of’ 
oi”’  of’ 


(3.89) 


is  therefore  the  rate  transition  matrix  that  contains  no 
states  with  the  n-job  present.  The  probability  vector  that  is 
associated  with  the  arrival  of  the  n— job  can  be  calculated  as 


Pit)  =P(0) 

oo 

■=  jp  it)  dt  -P  (0) 

0 


Assuming  that  the  system  always  starts  idle  (from  state  1),  we 
can  write  as 

(3.90) 

When  the  n-job  arrives^  it  will  have  to  wait  if  any  other 
jobs  are  in  the  system.  The  states  k=2""Hi,  i = l,..., 
are  those  states  in  which  the  n-job  are  present;  the  only 
state  in  which  the  n-job  can  be  serviced  is  state  2""^  + l,  in 
which  no  other  jobs  are  in  the  system. 
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Let  be  the  first  passage  time  from  state  i to  state 


j,  and  the  vector  of  first  passage  times  is 


(tt  i-  \ 

' / ^2"-U2->2"-Ul  ' ^2"->2"-^  + l^ 


(3.91) 


thus  the  expected  initial  waiting  time  for  the  n-job  is 


£[Wo‘"’  ] = Tt'"’  r'"* 


(3 . 92) 


The  general  form  of  the  delay  factor  for  any  j-job  can  thus  be 
written  as 


CfO') 


E [ ]+E[  ] 

E [ T^,„  ] 


(3.93) 


As  shown  in  the  above  calculations,  the  addition  of  one 
job  doubles  the  state  space  of  the  model . However,  since  the 
higher  priority  jobs  are  unaffected  by  lower  priority  jobs, 
the  solutions  of  the  performance  measures  for  the  highest  n-1 
jobs  need  not  be  recalculated.  Thus,  only  the  performance 
measures  of  the  n-job,  the  lowest  priority  job  needs  to  be 
calculated . 
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h1(r1) 


Figure  3.1  State-Space  of  M/G/1/2/2/1  Model 


Figure  3.2  Sample  Realization  of  M/G/1/2/2/1  Model 


PC  System  Idle] 
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Figure  3.3  Markov  Model  of  M/M/1/2/2/1 
Basic  Preempt ive— Resume  Queueing  System 


M/  M/  1/  2/  2/  1 Mode  i 


0 2 4 6 8 10 

11  : 1-Job  Arrival  Rate 

□ 12  = O.OQS  + 12=0. 5 o 12=5. □ 


Figure  3.4  M/M/1/2/2/1  Model 

Probability  that  the  Server  is  Idle 


PC  2- Job  Alone]  PC  1- Job  Alone] 


M/  M/  1/  2/  2/  "1  Mode  I 


11  : 1-Job  Arrival  Rate 

□ 12=0.05  + 12=0. 5 o 12=5. 0 


Figure  3.5  M/M/1/2/2/1  Model 

Probability  that  the  1-Job  is  Alone  in  the  System 

M/M/1/2/2/1  Model 


II  1-Job  Arrival  Rate 

□ 12=0. 05  + 12=0. 5 O 12=5. 0 

Figure  3.6  M/M/1/2/2/1  Model 

Probability  that  the  2-Job  is  Alone  in  the  System 


PCX  !n  SvC2D]  PCX  in  WC2D3 
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M/  M/  1/  2/  2/  1 Mode  I 


M : i-Job  Arrival  Rate 

□ 12=0.05  + 12=0. 5 o 12=5. 0 


Figure  3.7  M/M/1/2/2/1  Model 

Probability  that  the  2-Job  is  Preempted 

M/  M/  1/  2/  2/  1 Mode  I 


2^6  8 10 


11  1-Job  Arrival  Rate 

□ 12=0. 05  + 12=0.5  o 12=5.0 

Figure  3.8  M/M/1/2/2/1  Model  Probability 

that  the  2-Job  is  either  Preempted  or  in  Service 
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M/  M/  1/  2/  2/  1 Mode  I 


11  1-Job  Arrival  Rate 

12=0.05  + 12=0. 5 o 12=5. 0 


Figure  3.9  M/M/1/2/2/1  Model  Probability 

that  the  2— Job  has  Arrived  but  not  Received  Service 


M/M/  1/  2/  2/  1 Mode  I 


II  1-Job  Arrival  Rate 

12=0. 05  + 12=0. 5 o 12=5. 0 


Figure  3.10  M/M/1/2/2/1  Model  2-Job  Virtual  Arrival  Rate 


2- Job  Delay  Factor  2- Job  ConMaletlon  Time 
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M/M/  1/  2/  2/  1 Mode  I 


2- Job  Completion  Time  vs.  M 


11  : 1-Job  Arrival  Rate 

□ I2=Q.Q5  + 12=0.5  O 12=5. 0 


.gure  3.11 


M/M/1/2/2/1  Model  2-Job  Completion  Time 


M/M/1/2/2/1  Model 


26 
24 
22 
20 
10 
IS 
14 
12 
10 
8 
6 
4 
2 
0 

0 2 4 6 a 10 

II  1-Job  Arr 1 va I Rate 

□ 12=0. 05  + 12=0. 5 O 12=5. 0 


Figure  3.12  M/M/1/2/2/1  Model  2-Job  Delay  Factor 


P[1-Job  Alone]  PCSystecn  Idle] 


100 


M/  M/  1/  3/  3/  1 Mode  I 


11  : 1-Job  Arrival  Rate 

□ 12=0. 05  + 12=0. 5 o 12=5. 0 


Figure  3.13  M/M/1/3/3/1  Model 

Probability  that  the  System  is  Idle 

M/  M/  1/  3/  3/  1 Mode  I 


II  ; 1-Job  Arrival  Rate 

□ 12=0.05  + 12=0. 5 o 12=5. 0 


Figure  3.14  M/M/1/3/3/1  Model 

Probability  that  the  1-Job  is  Alone 


PC  3- Job  Alone]  PC  2- Job  Alone] 


101 


M/  M/  1/  3/  3/  1 Mode  I 


11  : 1-Job  Arrival  Rate 

° 12=0.05  + 12=0. 5 o 12=5. 0 


Figure  3.15  M/M/1/3/3/1  Model 

Probability  that  the  2-Job  is  Alone 

M/  M/  1/  3/  3/  1 Mode  I 


II  : 1-Job  Arrival  Rate 

'2=0- 05  + 12=0, 5 o 12=5. 0 


Figure  3.16  M/M/1/3/3/1  Model 

Probability  that  the  3-Job  is  Alone 


PCX  in  WC3DD  PCX  in  WC2;)] 
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M/M/  1/  3/  3/  1 Mode  I 


M : 1-Job  Arrival  Rate 

□ I2=Q.Q5  + I2=Q.5  o I2=5.Q 

Figure  3.17  M/M/1/3/3/1  Model 

Probability  that  the  2-Job  is  Preempted 

M/  M/  1/  3/  3/  1 Mode  I 


PCX  I n vs . M 


11  1-Job  Arrival  Rate 

□ 12=0.05  + 12=0. 5 o 12=5. 0 


Figure  3.18  M/M/1/3/3/1  Model 

Probability  that  the  3-Job  is  Preempted 


PCX  in  SvC3D]  PCX  in  SvC2:)] 


M/  M/  1/  3/  3/  1 Mode  I 


0 2 *4  6 0 10 

11  : 1-Job  Arrival  Rate 

□ 12=0. 05  + 12=0. 5 o 12=5. 0 

Figure  3.19  M/M/1/3/3/1  Model  Probability 

that  the  2-Job  is  either  Preempted  or  in  Service 

M/  M/  1/  3/  3/  1 Mode  I 


PCX  in  SvC3:):  vs . I 1 


II  1-Job  Arrival  Rate 

□ 12=0. 05  + 12=0. 5 O 12=5. □ 


Figure  3.20  M/M/1/3/3/1  Model  Probability 

that  the  3-Job  is  either  Preempted  or  in  Service 
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2 4 6 8 10 


11  : 1-Job  Arrival  Rate 

° 12=0.05  + 12=0. 5 o 12=5. 0 

Figure  3.21  M/M/1/3/3/1  Model  Probability 

that  the  2-Job  has  Arrived  but  has  Not  Received  Service 


M/  M/  1/  3/  3/  1 Mode  I 


II  : 1-Job  Arrival  Rate 

□ 12=0. 05  + 12=0. 5 o 12=5. 0 

Figure  3.22  M/M/1/3/3/1  Model  Probability 

that  the  3-Job  has  Arrived  but  has  Not  Received  Service 


-Job  Virtual  Arrival  Rate 
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M/  M/  1/  3/  3/  1 Mode  I 


11  : 1-Job  Arrival  Rate 

° I2=Q.Q5  + 12=0.5  o 12=5. 0 


Figure  3.23  2-Job  Virtual  Arrival  Rate 

M/  M/  1/  3/  3/  1 Mode  I 


° 2 4 6 8 10 

II  1-Job  Arrival  Rate 

n 12=0. 05  + 12=0. 5 o 12=5.0 


Figure  3.24 


3-Job  Virtual  Arrival  Rate 


EC  3- Job  Completion  Time]  EC  2- Job  Completion  Tlrr>e] 
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Q 2 -4  6 0 10 


11  1-Job  Arrival  Rate 

□ I2  = Q.Q5  -I-  12  = 0.5  O 12=5. 0 

Figure  3.25  2-Job  Completion  Time 


W W 1/  3/  3/  1 Mode  I 


II  1-Job  Arrival  Rate 

□ 12=0. 05  3-  12=0. 5 O 12  = 5. 0 


Figure  3.26 


3-Job  Completion  Time 


3- Job  Delay  Factor  2- Job  Delay  Factor 

CThouBands]) 


M/  M/  1/  3/  3/  1 Mode 


10 


1 2 = 0.05 


11  : 1-Job  Arrival  Rate 
+ 12  = 0.5 


2 = 5.0 


Figure  3.27  2-Job  Delay  Factor 


2 4 6 8 10 


□ I2  = 0.05 


II  1-Job  Arrival  Rate 

+ 12  = 0.5  o 12  = 5.0 


Figure  3.28  3-Job  Delay  Factor 


CHAPTER  4 

CONTINUOUS  STATE  MODELS  WITH 
BOUNDED  SERVICE  TIME  DISTRIBUTIONS 


Deterministic  Service  Times 

In  this  section  we  will  analyze  the  case  when  the  service 
times  are  constant.  That  is,  the  distribution  function  of 
jobs  of  priority  class  i can  be  written  as 


Because  of  the  discontinuities  in  the  service  time 


models  are  different  from  those  derived  for  the  M/G/l/n/n/1 
model.  Another  difference  between  the  M/G/l/n/n/1  model  and 
those  that  will  be  discussed  in  this  section  is  that  in 
addition  to  the  2"  subspaces  present  in  the  M/G/l/n/n/1  model, 
the  models  with  deterministic  service  times  have  subspaces 
corresponding  to  the  boundaries  along  which  the  highest 
priority  job  in  that  subspace  is  being  served  when  other  jobs 
are  present  and  waiting  to  begin  initial  service.  Although, 
strictly  speaking,  these  regions  are  manifolds  rather  than 
subspaces,  this  distinction  does  not  affect  our  analysis. 


0 otherwise 


1 if  rj>k^ 


distributions,  the  defining  differential  equations  for  these 


108 


109 


We  will  now  proceed  by  first  deriving  results  for  the 
M/D/1/2/2/1  model  and  then  developing  the  results  for  the 
M/D/1/3/3/1  model. 

The  notation  will  be  used,  where  the  underlined  indices 
will  represent  those  jobs  that  are  present  but  have  never 
started  service. 

2-Class  Case:  M/D/1/2/2/1  Model 
Density  functions 

The  state-space  for  this  model  is  similar  to  that  of  the 
M/G/1/2/2/1  except  that  it  is  bounded  to  a rectangular  region 
of  size  kik2.  Figure  4.1  shows  this  state-space. 

As  before,  we  will  use  h^^  ( • ) to  represent  the  density 
function  along  the  axis  where  only  the  i-job  (highest  priority 
job  in  the  subspace  O,,)  is  being  served.  For  example,  hi(ri), 
is  the  remaining  service  time  density  function  for  the  1-job 
while  the  2-job  is  not  in  the  system.  The  function  hi2(ri)  is 
the  remaining  service  time  density  function  of  the  1-job  when 
the  2- job  is  present  but  never  has  started  service. 

The  last  density  function  in  this  model  is 
corresponding  to  those  state  where  both  the  1-job  and  the  2- 
job  are  present,  but  unlike  in  hi2(ri)  , the  2 — job  has  already 
started  service  but  is  preempted. 

Using  the  approach  outlined  for  the  models  with  general 
service  times  (M/G/ 1 /n/n/ 1 ) the  defining  equations  for  this 
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dhj  ( rj ) 


= (rj) 


dh^  ( rj ) 

dr. 


= ^^^2  (rj)  - gr(0,  r2) 


3g(rj,  r2) 


= 0 


ddj^(rj)  _ ^ 

A,2di(-Tj) 


In  addition,  we  have  the  following  boundary  conditions: 

( -^1  ) ~ Po^i 


h^{k^)  = Po^2+  ^2 


*1 

hj  ( r, ) dr, 
J 

r,=0 


hi2  (>:i)  = 0 
Pl2  k.2)  — 0 


Using  the  following  extension  of  Proposition  1, 
g ( 0 , rj ) = h2  ( r2 ) A,, 


we  can  solve  sequentially,  for  all  of  the  probability  density 
functions.  Using  the  normalizing  equation,  we  can  then  solve 
for  Po,  hence  obtaining 


hj  (rj)  = Po?ije'^dh-n) 

(4.1) 

hj  (r2>  = Po  (^2+  ^1  (l-e'^=*')  ) 

(4.2) 

hi2  (ri)  = Po?i^  (1-  e‘^dh-n>) 

(4.3) 

gi2  (r^,  r2)  = Pq?*-!  (^2+  ) 

(4.4) 

Ill 


+ ?i^;c2(l+  X^k^)  (l-e"^^^0  )~^ 


Performance  measures 

Equations  4.1,  4.2,  4.3  and  4.4  and  the  normalizing 
condition  completely  define  all  of  the  performance  measures. 
The  expected  duration  of  the  idle  period  of  the  server  is 


^[Duration  of  Idle  Pf^ri  nd]  = (4.6) 

The  proportion  of  time  that  the  1-job  is  alone  in  the  system 
can  be  found  by  the  integration  of  h^(ri)  over  the  interval 
[0,kj  . 


P [ 1-job  Alone]  = ( 1 - e 


(4.7) 


Similarly,  the  proportion  of  time  that  the  2-job  is  alone  in 
the  system  can  be  found  by  integration  of  h2(r2)  . 


P[2-job  Alone]  = ) (4.8) 

The  proportion  of  time  that  the  2— job  is  preempted  is  given  by 
integrating  gi2(ri,r2)  over  the  entire  region. 


ProblXe  ] = g.^2  (r^,  r,)  dr^dr 


J 

0 0 


(^2+  ^1  (l-e'^^'^')  ) 


(4.9) 
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As  before,  the  expected  in-process  waiting  time  of  the  2- 
job  is  the  product  of  the  expected  number  of  preemptions  of 
the  2-job  and  the  expected  duration  of  those  preemptions  (the 
expected  service  time  of  the  1-job) . This  is  evaluated  as 

E[T„,,,]  = X^E[T^,,,]E[T^..,]=X^k^k^  (4.10) 

The  virtual  service  time  consists  of  the  in-process 
waiting  time  and  the  actual  service  time.  Therefore,  the 
probability  that  the  2-job  is  either  being  served  or  is 
preempted,  and  the  expected  virtual  service  time  are 


Prob[XeSv^^  ] = \\9i2  ^2)  dr2dr^+  fhj  {r^)  dr. 

OX)  X) 


0 

-Kk. 


= p^X^k^k^  1X2+  X^(l-  ^ ‘)  ) 

^ 1 - 
+ PoK  (^1-  — — ) 


£ [ r^,.,  ] = £ [ ] + E[T^,,,] 


= k^  (X^k.^  + 1) 


(4.11) 


(4.12) 


Similarly,  the  probability  that  the  2-job  is  waiting  for 
initial  service  is  calculated  by  the  integration  of  hi2(ri). 


Prob[X€ 


r 


]=  hj2(rj)dr3 


0 


Po^l  ( 


1 - e 


X 


(4.13) 


the  expected  initial  waiting  time  is 


£[T„,.,]  = A-2  Jridr,= 

0 


^2^1 


2 


(4.14) 
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and  the  probability  that  the  2-job  is  in  the  system  is  given 
by 

Prob[XeC^^^  ] = Prob[XeW^^'  ] + Projb[XeSv^*  ] 

^p^X,k,{2+  ) ) (4.15) 

Similarly,  the  expected  completion  time  of  the  2-job  is 


E [ T^,2,  ] — £/  [ T^I2>  ] + JEJ  [ T^I2I  ] 


^2-^1 


k,(X,k^  + l) 


(4.16) 


Using  the  results  for  the  expected  completion  time  and 
the  expected  in-process  and  initial  waiting  times,  the  virtual 
arrival  rate  and  the  delay  factor  for  the  2 — job  are  now 
obtained  in  closed  form. 


{E[ 


-1 


E [ T„,2,  ]+E[  T„,2,  ] 
E L r^,,,  ] 


(4.17) 

(4.18) 


Figures  4.2  to  4.10  show  graphs  of  these  performance  as 
the  arrival  rates  of  the  1-job  and  the  2— job  are  varied.  For 
the  purpose  of  generating  these  graphs,  the  service  time  of 
both  the  1-job  and  the  2-job  are  set  to  2. 


3-Class  Case:  M/D/1/3/3/1 


4 
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Density  functions 

The  state-space  is  partitioned  into  14  subsets  as 
described  in  Table  4.1. 

In  each  subspace,  only  the  highest  priority  job  present 
in  that  subspace  is  being  processed. 

In  the  following  paragraphs,  differential  equations  will 
be  developed  for  each  of  the  abovement ioned  subspaces.  These 
equations  will  be  solved  to  find  the  density  functions  in 
those  spaces . 

As  in  previous  sections,  the  analysis  is  for  the  steady- 
state  conditions.  The  equations  will  first  be  shown  in  their 
full  form,  and  then  simplified  accordingly. 

The  first  differential  equation  will  be  for  the  axis 
along  which  only  the  class-one  (highest  priority)  job  exists. 


(rj,  t+dt)  = hj  (rj+dr,  t)  (l-X^dt)  (1-Xjdt) 

dh,  (r, ) 


(A,2+X,3)  (rj) 


t + dt)  = h^ir^  + dr,  t)  il-X^dt)  (1-X^dt) 

+ 9i2^  t)  dt  (1-X^dt) 


dh^  ( rj ) 


dr. 


(X,|  + X.3)  II2  ( ^2  ) ^2^ 


t+dt)  = h^irj  + dr,  t)  (1-X^dt)  (l-^jdt) 

+ gj3  (dr,  r^,  t)  dt+  ^33  (dr,  r^,  t)  dt 


dh^ir^) 


dr. 


(X^ +X2)  hj  ( r^)  9:3  (O^r^)-  923  (Ofr^) 


Table  4.1  Subsets  of  State-Space 
of  M/D/1/3/3/1  Model 
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Subset  # 

System  State 

Description 

1 

Xi  (t)  =X2  (t)  =X3  (t)  =0 

Server  is  idle 

2 

Xj  (t)  =r, , 

X2  (t)  =X3  (t)  =0 

l-Job  alone  in  the 
system 

3 

Xi(t)=0,  X2(t)=r2, 

X3  (t)  =0 

2-Job  alone  in  the 
system 

4 

Xi(t)=X2(t)=0, 
X3 (t)  =r3 

3-Job  alone  in  the 
system 

5 

Xi  (t)  =rj,  X2  (t)  =r2, 
X3(t)=0 

2-Job  preempted  by 
the  1-job 

6 

Xi  (t)  =ri,X2  (t)  =0, 
X3(t)=r3 

3-Job  preempted  by 
the  1-job 

7 

Xi(t)=0,X2(t)=r2, 
X3  (t)  =r3 

3-Job  preempted  by 
the  2-job 

8 

Xi  (t)  =ri,  X2  (t)  =k2, 
X3(t)=0 

2-Job  arrived  while 
1-job  in  service 

9 

Xi(t)=ri,X2(t)=0, 

X3(t)=k3 

3-Job  arrived  while 
1-job  in  service 

10 

Xi(t)=0,X2(t)=r2, 

X3(t)=k3 

3-Job  arrived  while 
2-job  in  service 

11 

X3  (t)  ==ri,  X2  (t)  =k2, 
X3(t)=k3 

2-Job  and  3-job 
arrived  while  1-job 
in  service 

12 

Xi  (t)  =ri,  X2  (t)  =r2, 
X3(t)=k3 

3-Job  arrives  and 
2-job  preempted 

13 

Xi  (t)  =ri,  X2  (t)  =k2, 

X3(t)=r3 

2- Job  arrives  and 

3- job  preempted 

14 

Xi  (t)  =ri,  X2  (t)  =r2, 
X3  (t)  =r3 

2-Job  and  3-job 
preempted 

The  next  three  equations  are  for  pairs  of  job-classes 


being  present. 
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g-12  (ri,  r2,  t+dt)  = gj2  (rj+dr,  r2,  t)  (l-^,dt) 


Ajg-^2  ^2^ 


Similarly, 


gi3  (r,,  rj,  t^,)  = g^3  (r^+dr,  r3,  t)  (1-A.3dt) 
dg^.ir^r^)  _ ^ ^ ^ ^ 

^2  9^13  '-^1'  -^3' 


g^^ir^,  r^,  t+dt)  = g^^ir^+dr,  r^,  t)  {1-X,dt) 

+ u (dr,  r^,  r^,  t)  dt 


dg^2  (r^,  r 2) 
dr. 


^1  9'^2  3 ^ ■^2  ' "^3  ^ ^ r ^2  ' ^ 2^ 


For  the  three-dimensional  space,  the  equation  is  as 


follows . 


^123  (-^1'  ^2!  ^2'  t + dt)  = u (rj+dr,  r^,  r^,  t) 
duir^^r^tr^) 


In  addition,  we  consider  those  states  where  some  low 
priority  job  is  in  its  initial  waiting  period. 


^32  (r^,  t+dt)  = hi2(r3+dr,  t)  (l-X^dt) 

+ h-^  (r^  + dr,  t)  X^dt  (1- X^dt) 

dh,  2 ( r, ) 

= X^h^^ir.^)  - X2h^  (rj) 
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t + dt)  ^ *23  (r^+dr,  t)  (l-?i,dt) 

+ h2  (r^+dr,  t)  A,3dt+ gj23  (dr,  r2>  dt 

dti22  (rj) 

A,3h22^  (1^2)  ~ ^3^2  ^^2^  ~ 9^123  ^ ® ' -^2  ^ 


di^(ri,  t+dt)  = h33(r^+dr,  t)  (1-X2dt) 

+ dj  (r^+dr,  t)  ^.jdt  (1- A-2dt) 


dd^3  (r, ) 


dr^ 


^2^13  ^ ^ ^3^1 


hi^{r,  ,t  + dt)=  d^23  t)  + h^2  t:)  X^dt 

+ d^3  (r^+dr,  t)  ^2<^t 


^ "^1  ^ 
d?; 


^3^12  (rj)  X,2d]^3(rj) 


9^1 22  ^ "^1 ' ■^2 ' t + dt)  = ^123  (-^i+c/r,  rj,  t) 

+ gi2  (r^+dr,  r2)  ^jdt 


‘^9'^123 


dr. 


= = -^39^12  ■^'2) 


9^123  ^3f  t+dt)  = gj23  (r^+dr,  r^,  t) 

+ g^3  (r^+dr,  r3>  X2dt 

*^9^123  . 

-=  -^29^13  ^3) 


dr 


The  following  boundary  conditions  exists  for  this  system 

hi  (di)  =PqXi 


c 

hj  (^2)  = ^2  [fo+  hi(ri)dri] 


0 


■^3  ^ ^3  ^ ~ ^3  t i^O 


0 


h^{r^)  dr^+  h^{r^)  drj 


j 

n 


5^12  ^2^  ~ ^ 


9'i2  -^2)  = ^1*2  (-^2) 

g^^{k^,r^)=X^hj{r^) 
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5^1 3 ( -^1  f kj ) — 0 


5^23  ^^2'  ^3)  ~ ® 

h^^(k^)  = 0 

*13  (^1)  = 0 


5^23  ^*2^  "^3^  ^2*3  ^*^3) 


r3 ) dr^ 


^1  ^1 

■^23  ^^2^  ~ ^ CfiT^  + X>2  ^12  CfiT 

0 0 


^123  ( 0 


^123^^  ^1  f ^2^  ^ 9^123  (“^1^  -^2^  “ ^l‘^23  (^2^ 

5^123  (-^1/  -^3)  “ Q 

^123  ^2f  ^3^  ~ ^ 


In  order  to  solve  these  differential  equations 
sequentially,  extensions  of  Propositions  2,  3,  4 and  5 need  to 
be  used.  These  extensions  are 


g^2  (Oa  ^2)  = (r^) 

g^3  (0,  r^)  = X^h^  {r^) 

922(0,  r^)  = X^h^  (r^) 

^1  2_3  ^ ® ' "^2  ) ~ ^1  ^23^  ( ^2  ) 

^12  3 ( ® ' ^2'  -^3  ) “ ^1  9^2  3 ( ^2  ' ^3  ) 

The  density  functions  defining  the  state  space  of 
M/D/1/3/3/1  can  be  written  as 
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(4.19) 

*2(^2)  =Pop2e'"^‘*''"^’ 

X 

where  Pj=  X-2  [1+  L_  (1-  ] 

^1  + ^3 

and  C2=  (1- + A.3 

(4.20) 

^3(^2) 

where  0,=  X,{l  + ^ ( 1 - +^} 

C2 

and  03=  ^3  ( 1 - e'^=*‘) 

(4.21) 

^32  (-'^l/  ^2')  = Po^iP2e‘^’**''''^'’'‘'^‘*^''''’ 

(4.22) 

g33  (r3,  r3)  =Po^3P3e'^'‘*‘‘^'’"'’‘*’'^=’ 

(4.23) 

P23  (^2f  ^3)  = Pop3e'^’‘**'^’M^2  + ^i 

(4.24) 

^32  (r3)  = PoX.3e'^’‘*‘'-^‘’  ] 

(4.25) 

*33  (r3>  = PoX3e"^^^ [l-e"^‘ ] 

(4.26) 

^23  (r2)  = Pg{  [1-  ] 

C2 

+ A.3  d-e''^^*')  (l-e'^’'^') } 

(4.27) 

^123  (d) 

+ 1 2 [ T j 1 

^2  J 

1 (4.28) 

Pi23  d)  =Po^ip2  tl-  ] 

(4.29) 

Pi23  ^^3)  =Po^iP3  (1-  ) 

(4.30) 

U323  (r3,  r2,  r3)  = Po>.3>.2p3e'^’'*’'^’’ 

(4.31) 
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Performance  measures 

In  Chapter  3,  in  order  to  calculate  the  performance 
measures,  we  used  the  fact  that  the  service  times  are 
exponentially  distributed.  However,  since  the  service  times 
are  deterministic  in  this  M/D/1/3/3/1  model,  there  are  other 
more  direct  approaches  that  can  be  used  for  those 
calculations . 

As  discussed  in  calculating  the  density  functions,  the 
state  space  of  this  M/D/1/3/3/1  model  has  14  distinct 
subspaces.  Unlike  the  M/M/l/n/n/1,  these  subspaces  are 
defined  for  all  of  the  performance  measures  that  need  to  be 
calculated . 

The  probability  that  the  system  is  idle  can  be  calculated 
by  taking  the  inverse  of  the  sum  of  the  integrals  of  the 
density  functions  of  the  14  subspaces  over  all  values  of  the 
remaining  service  time. 


3 


-1 


(4.32) 


The  expected  duration  of  the  idle  period  is  given  by 
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E[Duration  of  Idle  Period]  = 


1 


"^^2  "^^3 


(4 . 33) 


The  probabilities  that  the  1-job,  the  2-job  or  the  3-job  is 
alone  in  the  system  can  be  calculated  as 


P[l-job  Alone] 


P[2-job  Alone] 


P [3- job  Alone] 


Jhj  (r^)  dr^  = 

0 


0^1 


) 


r 


(r^)  dr,= 


j 

0 


Po^  (l_e-A) 


C- 


^3 

r 


(r^)  = 


j 

0 


PoP3  (i_e-3h) 


C- 


(4.34) 


(4.35) 


(4.36) 


The  probabilities  that  the  2 — job  or  the  3 — job  is  preempted  are 
given  by 


^ k 

P [Xe  ] = / /g  (r, , rj  dr,  dr. 

0 0 ^ i . 


+ fffgi^{r^,r^)  dr^dr. 
0 0 0 


k.k.k 


/ //ui23  (r^,  r^,  rj)  dr^dr^dr^^ 


0 0 0 


= P^X^k^k 


X2P 


2 r 2 


+ — r-1  (l-e'^"’*’) 

c. 


(4.37) 


J 
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k k 

P [Xe  ] = //g,  3 (r, , r3>  dr,  dr. 

0 0 


+ f fg23  (r^,  rA  dr^dr. 
0 0 


+ //gi„  (r^,  r3)  dr^dr. 

0 0 ^ ■ 


-I- 


/ // U323  (r^,  rj,  r3)  dr^dr^dr^ 


000 


< 


= P0P3 


(>.3  +>^2)1:2  (4.38) 


c. 


The  probabilities  that  the  2-job  or  3— job  is  waiting  initially 
can  be  calculated  as 


P[XeWo^’  ] = /^i2  dr^  + /d323  (r^)  dr, 

0 - 0 — 


+ hg323  (r^,  rd  dr,dr. 
0 0 - 


Po^iil  (1-4^) 


X. 


J_  (1+li  (1 -€■'"=*=)  ) 

^2  ^3 


^2  "^^3 


^2  ~^^3 


2?i,  X,  1 

•^l  ^ ^ ~ 1 -p- P3-^3  ) ( 

/v^  ' ^^3  ^^3  I 


(4.39) 
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^ )c 

P[X€lVo^’]=  /hj3(rj)  dr^+  dr2+  fh^2^{r^)dr^ 

+ i i g^2i^r^,  r^)  dr^dr^ 


{^l  -1)  (i-e-<^=*^3.*>) 

A.2+A3  A,2+A,3 


-Kk, 


+ [A:^  (l-e'^=*0  -_4--^  (l-e“^'*=)  ] (l-e’"'"') 

M C2A3 


+ 


^1-^1  [^2  ^ T~  T — T7~^  +l+p2-^2^  '*' 

A-3  A2+A.3 


p2-^2^2  1 


C. 


(4.40) 


The  probability  that  the  2-job  is  in  Sv‘^’  is  given  by  adding 
the  probability  that  it  is  preempted  or  is  in  service.  This 
type  of  relationship  also  hold  true  for  the  probability  that 
the  3-job  is  in  Sy*^’  . These  two  probabilities  can  be 
calculated  as  follows. 


P[X€Sy^’]=  P[Xeiy<2>] +P[ifeS<2)j 


= P [Xe  ] + f {r^)  dr^+  //g'23  (d'  -^3)  dr^dr 


Yi 

0 0 


= p 


0 


+ /h23  (d)  dr. 

0 - 

|P2 


X. 


(1-12) 


c. 


c. 


Ps^c 


+ 212  (l-e'^>*>)  (X^a+X^k^)  +X,  (l-e‘^'*‘)  ) 


+ ^1.^2  d-e^'^')  (l-e^=*‘)  + p2.k2 


X,k^ 


X. 


(4.41) 
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P[X€Sv^’]=  P[X€P/<3>]+  P[X€S‘^>] 

= P[XgP7<3>]  + fh.(r.)  dr, 

0 

= ^opsj-^  (l-e'">*>)  (1+[X,(1+X,k^)  +X,  d-e-’^^*')  ] k^) 

-f  . (4.42) 

We  can  now  calculate  the  expected  values  of  the  2- job's 
and  3- job's  cycle-times.  Since  the  cycle  time  is  made  up  of 
the  interarrival  time,  the  service  time,  the  in-process 
waiting  time  and  the  initial  waiting  time,  the  expected  values 
can  be  calculated  as 


E[y<2)  j ^ 


_ + E [ ]+E[  ] + E [ ] 

Ki 

k^+  P[XeW^^^]E[Y^^']  +P[lfeWo‘^’]E[y<2>] 


Solving  this  equation  for  the  expected  value  of  we  obtain 


E[  y<2)  ] 


1 -^X^k^  r 


P[XeW<2)  j 


(4.43) 


Therefore,  the  expected  cycle  time  of  the  2-job  can  be 
calculated  using  equations  4.37  and  4.39.  The  expected  values 
of  the  initial  waiting  time,  the  in-process  waiting  time  and 
the  virtual  service  time  can  thus  be  calculated  as 


E [ ] = 

p[X€W^^'  ] p[  ] 

(4.44) 

E [ ] = 

P[XeW^^'  ] E[Y^^'>  ] 

(4 . 45) 

E [ T,.,  ] = 

E[T^,,,]  + E[T^a,]=  k^+ElT^,,,] 

(4.46) 
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Using  this  same  approach  for  the  3-job,  the  expected 
values  of  the  cycle  time,  the  waiting  times  and  the  virtual 
service  time  can  be  written  as 


l+XjJCj 


E[T„,,,]  = P[XeW^^^]E[Y^^^] 

E[T„,„]  = P[XeP\^cJ^’]£[r<3>] 

E [ r^o.  ] = B [ T^,„  ] + E[  r„,„  ] = k,+  E[  T„,„  ] 


(4.47) 

(4.48) 

(4.49) 

(4.50) 


Using  the  expressions  given  in  Chapter  1,  the  virtual  arrival 
rates  and  the  delay  factors  for  any  j-job  (j=l,2,3)  in  this 
M/D/1/3/3/1  model  can  be  calculated  as 


1 

£[  Y‘J>  ] 


E [ T^,„  ] + £ [ ] 


T 


1 


Figures  4.11  to  4.26  show  graphs  of  these  performance 
measures  as  the  arrival  rates  of  the  1-job  and  the  2-job  are 
varied.  For  the  purpose  of  generating  these  graphs,  service 
times  of  the  1-job,  the  2- job  and  3- job  are  set  to  2.  The 
expected  interarrival  time  of  the  3- job  is  also  set  to  2. 

n-Class  Case:  M/D/l/n/n/1 

Let  the  random  variable,  corresponding  to  the  j-job 


be  defined  as 
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0 

1 


X^=0 

0<Xj<k^ 

X^=k. 


Not  all  combinations  of  the  x^s  are  possible;  for 
example,  the  condition  x^<Xj  for  all  i<j  must  always  be 
satisfied.  Let  X=  (Xj , X2,  . . . , x„)  . There  are  3"“^  possible  forms 
of  the  vector  X for  the  cases  in  which  the  i-job  is  the 
highest  priority  job. 

Some  of  these  combinations  are  boundary  points  of 
densities.  Since  the  highest  priority  that  is  present  at  any 
time  completes  service  before  any  other  job,  there  are  3"'^ 
subspaces  which  contain  the  1 — job  with  kj^  remaining  service 
time;  that  is  the  1— job' s arrival  causes  a transition  into 
these  subspaces . 

Similarly,  there  are  3""^  subspaces  in  which  the  i-job  is 
the  highest  priority  job  (the  i-job  immediately  begins 
service),  which  are  gotten  to  by  the  arrival  of  the  i-job. 

Since  the  idle  state  has  its  own  density  mass,  the  number 
of  subspaces  with  associated  density  functions  are 


Number  of  Density  Functions^  3^-  [1+  X)3'’"-‘] 

i=l 

The  formulation  of  the  differential  equation  that  is 
associated  with  a general  subspace  is  given  as 
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u^^(r.,  • , t+dt)  = u^Jr^  + dr,  ' , t)  JJ  (1-X^dt) 

^ ' ,t)dt 

>irr  ‘ 

J<i 


+ ^ ' t)  Xjdt 


Result  3 : 

For  the  M/  D / 1 / n/ n/  \ Model,  the  defining 
differential  equation  for  subspace  (j)^  is 


' ^ u j ( 0 ' ■ ) 


r.=  A:, 


All  of  the  approaches  outlined  in  the  previous  sections  can  be 
used  to  calculate  the  performance  measures  for  the  M/D/l/n/n/1 
model  for  a given  n.  As  noted  previously,  the  performance 
measures  associated  with  a job  is  unaffected  by  jobs  of  lower 
priority.  Thus,  an  iterative  procedure  can  be  used  to  find 
the  performance  measures . More  importantly,  to  find 
performance  measures  of  any  j-job,  only  the  M/D/l/j/j/1  model 
needs  to  be  analyzed  as  opposed  to  trying  to  analyze  the 
M/D/l/n/n/1  model . 


Uniform  [0,b1  Service  Times 


Models  with  unbounded  service  time  distributions  are 
discussed  in  Chapter  3.  These  models  contrast  with  the  models 
with  deterministic  service  time  distributions  that  are 
discussed  in  this  chapter.  This  is  not  only  because  of  the 
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fact  that  those  models  in  Chapter  4 have  manifolds  introduced 
into  the  state  space  by  the  bounded  service  time 
distributions^  but  also  because  with  the  deterministic  service 
times,  job  arrivals  can  only  occur  to  specific  points  in  the 
state  space. 

Models  with  uniformly  distributed  service  times  are  more 
mathematically  challenging  than  those  models  discussed  thus 
far,  because  they  combine  the  complexity  added  by  the 
boundaries  of  the  deterministic  service  times  and  the  infinite 
possibility  of  arrival  points  throughout  the  state  space  of 
models  like  those  with  exponentially  distributed  service 
times . 


2 Class  Model:  M/U/1/2/2/1 
Density  functions 

Using  the  same  approach  as  outlined  previously,  we  can 
calculate  the  differential  equations  that  help  define  the 
density  functions  associated  with  the  state  spaces . 


(rj,  t+dt)  = (r^)  + \ (r^+dr,  t)  (l-X^dt) 


dh^  ( ) 


b. 


+ 1.2^^  (rj) 


(4.51) 


hj  (rj,  t+dt)  = p^X^dtf^  (r^)  +h^  (r^+dr,  t)  {1-X^dt) 

+ g(dr,  r^)  dt 


dh^  { ) 


Po^2 


dr. 


b. 


+ X,h,  (r,)  - g(0,  r,) 


(4.52) 
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^12  ( -^1 ' t +dt ) = ( -^1  +dr,  t ) + ( r,  +dr,  t ) X^dt 


X,h,{r,) 

(4.53) 

9i2  (^1^  ^2>  t+dt)  = gj2  (^i+dr,  r^,  t) 

+ (r^+dr,  t)  X^dtf^  (r^) 

+ (r^+dr,  t)  X■^dtf■,  (r^) 

dg^2(^ifr2)  ^ 

(4.54) 

Using  an  application  of  Proposition  1 stated  in  Chapter 
3,  we  have  a fourth  equation  that  allows  us  to  solve  the 
differential  equations  sequentially. 


gi2  (0,  r^)  = hj  (r2)  X^+  -S  j (r^)  dr^ 

We  also  have  the  following  boundary  conditions . 

(4.55) 

(4.56) 

Pn^o 

h2(b2)= 

.■^2 

(4.57) 

*12  (bj)  = gi2  (bj,  bj)  = 0 

(4.58) 

We  can  now  calculate  the  remaining  service  time  density 
functions  for  the  M/U/1/2/2/1  model.  First,  for  those  states 


in  which  the  1-job  is  alone  in  the  system 
*i(ri)=  i^(l-  (I-A.2) 

(4.59) 

(4.59) 
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Next,  for  those  states  in  which  the  2-job  is  alone  in  the 
system  (being  served) , the  density  function  depends  on 
912  (Of  ^2)  • From  equation  4.55,  this  can  be  written  as 


PoK 

^1^2 


gi2(0,r,)=  hj  (r^)  >-1+ (1-J-)  (l-e'^=^')) 


^2  (r^)  = 


Po^2 

~rr 


+ 


Pr.’k 


V 


0''’1  Po^2 

5T  ~5T 


PoK 


(4 . 60) 


(X2-I)  (l-e'^=^') 


J 


(bj-r^) 


i'ha  third  group  of  states  are  those  in  which  the  2 — job  is 
waiting  initially  to  begin  service.  The  density  function  for 
these  states  can  be  written  as 


h,,(r,)  = [ (b,-r^)  + d-^)  ( 1 ) ] 


(4.61) 


The  final  group  of  states  are  those  in  which  the  2-job  is 


preempted . 


9i2  (^if  r^)  = 


Po^i 


(A.2  + 1)  (bj-r^)  + (1-..^)  ( 1 ) 


V 


xDi  A^2 


^ (b,-r,)  2 


/ 


2 -^2 


(4 . 62) 
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Performance  measures 

The  normalizing  condition,  equation  4.63,  can  be  used  to 
calculate  Po,  the  proportion  of  time  that  the  server  is  idle. 


r 


j 

0 


^2 

/ 

0 


r 


Po+  h^(t)dt+  h,(t)dt+  h,,  (t)dt 


J 

0 


Jj9’i2  (tj,  tj)  dtjdt2=  1 
0 0 


(4 . 63) 


Thus,  the  probability  that  the  system  is  idle  is  given  by 


P 


0 


3K. 


Tbl 


t; 


-I- 


X^bl 


^ (l+Xj)  +l-^+X^+X. 


-1 


(4.64) 


The  probability  that  the  1-job  is  in  the  system  alone  can 
be  calculated  by  integrating  the  density  function  h-^(r-^)  for 
values  of  r^  between  0 and  bj . 


b. 

r 


Prob[l- Job  Alone]  = h^(t)dt 


J 

0 


(3 . 65) 


Po^i 

^1^2 


1 


b,+  (1-^)  (1 


1 


y 


Similarly,  the  probability  that  the  2-job  is  alone  in  the 


system . 
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Prob  [2- Job  Alone]  = J h,  ( t)  dt 

0 

b 


■ = Po 


X 


X. 


\ 


\ 


y 


(4 . 66) 


The  probability  that  the  2-job  is  waiting  to  begin  service  can 
be  calculated  as 


P[Xewi^^] 


0 


( t)  dt 


■Po^i 


bt 

T 


1 


V 


+ (1-T-) 

A.2 


e-^h) 


(4.67) 


Also,  the  probability  that  the  2-job  is  preempted  is  given  as 


P[XeW^^^  ] = rfg^2  (-^1' -^2) 

J J c 

0 0 


p^X^b2'^< 

Sb7“ 


(1  + ^2)^!  . 1 . 1 --X,b 


+ (1-^)  [bj-^  d-e'"^"')  ] 


t; 


(4 . 68) 


+ 


+ X 


X. 


2 + -^  (1--1)  d-e'^^"’') 
bi  X2 


.3. 


The  in-process  waiting  time  of  the  2-job  can  be 
calculated  by  multiplying  the  expected  number  of  preemptions 
of  the  2- job  by  the  expected  duration  of  those  preemptions. 


E [ ] = X^E[  t^,3, ] E [ r^,.,  ] = 


(4 . 69) 


The  expected  value  of  the  virtual  service  time  is  given  by  the 
sum  of  the  expected  in-process  waiting  time  and  the  expected 


service  time. 
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jb, 

E [ ] - £ [ r„,„  ] + E[T^,,,]  = ^ 

The  expected  initial  waiting  time  of  the  2-job  can  be  written 
as 


(4.70) 


£[T,,„l  = Xir,dr,=  i^  (4.71) 

"o 

The  expected  completion  time  is  given  by 

E[r^,„]  = E[T„,a,]  +E[T5d,]  (4.72) 

This  helps  define  the  expected  virtual  interarrival  time  and 
the  expected  arrival  rate  as 


E[2-job  Interarrival  Time] = 


1 

1 (2) 
A.\y 


= E[T<^>] 


= E [ ] + 


1 


(4.73) 


Using  equations  4.69  and  4.71,  the  2-job  delay  factor  can  be 
written  as 


E [ T^ni  ] + E [ ] 

E [ ] 


(4.74) 


Figures  A .21  to  4.35  show  graphs  of  these  performance  as 
the  1-job  and  2-job  arrival  rates  are  varied.  For  the  purpose 
of  generating  these  graphs,  the  expected  service  times  of  the 
1-job  and  the  2- job  is  set  at  2.  That  is  the  value  of  bj  and 
bj  is  4. 


134 


3 Class  Case:  M/U/1/3/3/1  Model 
Density  functions 

The  defining  differential  equations  can  be  written  using 
the  same  approach  as  used  for  the  other  models. 

The  first  differential  equation  will  be  for  the  axis 
along  which  only  the  class-one  (highest  priority)  job  exists. 


dha  ( rj ) _ 
drj 

(Xa+^3>  *1 

(4.75) 

dha ( ra ) _ 

dr^ 

(Xj+^a)  ha  (ra)  - - g^2(0,ra) 

(4.76) 

dh^ir^)  ^ 

(X^+X^)  ha  (ra)  - E^-  g^^{0 , r^)  - g^^{0,r^) 

(4.77) 

The  next  three  equations  are  for  pairs  of  job-classes 


being  present . 


dg,.{r.,rj)  . X,  X, 

= X,g,,  {r,,  r,)  - h,  (r,)  - (r^) 


(4.78) 


Similarly, 


dg,3  (r^,  r3) 


X 


K 


= X,g,,  (r,,  r,)  - —h,  (r^)  - {r^) 


(4.79) 


dr. 


X^ 


X. 


(rj,  ra)  - (r^)  - ^ha  (ra) 

- u,,a  (0,  r,,  r,) 


(4 .80) 


For  the  three-dimensional  space,  the  equation  is  as 


follows . 
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dUi23  {r^,  Tj) 


X. 


X 


K 

•t:— 9^23  (-^2'  -^3^ 
■^1 


(4.81) 


In  addition,  we  consider  those  states  where  some  low 
priority  job  is  in  its  initial  waiting  period. 


dhj2  (r^) 


dii22  ( ^2  ^ 
dr^ 

dhi^  ( iTj^ ) 
'^^122  ^ ■^l  ^ 

dr. 


dg 


123 


c(5ri23 

dr, 


?i3bi2  (r,)  - h,  (r,) 

IJ2 

(4.82) 

^1-^23  (^2)  9^123  (^'^2^ 

■^3 

(4 . 83) 

^2*^13  -_hi(2Ti) 

(4 . 84) 

) >.3  >.2 

X>>3  X^2 

(4 . 85) 

^3  ^1  ^2 

-^9^12  (^1'  ^2^  ~ -^^23  (^2^  “ "-^^13  (-^1) 

(4 .86) 

^2  ^3 

^g33(rj,r3)  -^bi2(r3) 

(4.87) 

The  following  boundary  conditions  exists  for  this  system 


K 

^1  (di)  =Po3^ 


(4 . 88) 


hj  (b2)  = 


X 


^[Pq4  hi(r,)drj 


(4 .89) 


^3  (^3)  = 


/v 

^ [ Po+  I h,  ( r^ ) dr,_  + | hj  ( r2 ) dr2 ] 


J 

0 


0 


9^1 2 ^ dx  / -(^2 ) 0 


Xi 

g,2  (b, , rd  = —h,  (rj) 


b. 


(4 . 90) 


(4.91) 
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g^^(b^,bj)  = 0 g^3  (l?i,  rj)  = ^*3  (rj)  (4.92) 


^23  (-^2  / -^3  ) ~ ® 

5^23  (^2r  -^-3)  = -^^3  (-^^3) 

A, 

2 0 

(4.93) 

(i^i)  = 0 

(4 . 94) 

*13  = 0 

(4 . 95) 

r 

*23  (*2  ) “ -^13 

2*0 

'I 

A.  r 

(r^)  dr^H-  " h32  (r^)  dr, 

-°3-6  ~ 

(4.96) 

*i^(*i)  = 0 

(4.97) 

9^12  3 ^ *1  / *2  ) — ^ 

5^123  (-^1^  ^2^  ~ -f-^22  ^^2^ 

(4 . 98) 

9^123  (*i  f *3  ) = 0 

(4 . 99) 

^123  (*l  / *2  ' “^3  ) “ 

0 

(4 .100) 

In  order  to 

solve  these  differential 

equations 

sequentially,  extensions  of  Propositions  2,  3,  4 and  5 need  to 
be  used.  These  extensions  are 


g32  (0,  rj)  = 


^*2  (r^)  Je dr^ 

1 0 


^2  ^ 


hj  (rj)  e 


0 


^13  (0^  = 


r 


h^jirj)  e'^='''drj  + 

b,  J b.j 

3 0 


1 

/i.  r 


j 

0 


h,  (r, ) e'^^'^'dr 


■1  ' 1 


^3  ^ 

^23  ( 0 ^ -^3  ) - ^2-^3  ( -^3  ^ “E— 

D^J_ 


h^(r^)  dr 2 


0 


(4 . 101) 


(4.102) 


(4.103) 
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^123  (0,  r2)  = ^2')  ^-^i+  (-^1)  <^-^1  -104) 

^0  2*0 


X ^r 

Ui23  (0,  r2,  rj)  = X^g^^{r^,r^)  + ^(^13  r^)  dr^ 

2 0 


;i,7 


3 0 


Jg^i2 


(4.105) 


r. ) dr. 


The  density  functions  defining  the  state  space  of 
M/U/1/3/3/1  can  therefore  be  written  as 


=Po{^i  + Pie'^‘‘'’‘'^‘’} 


where  Yi=^2‘*‘^ 


Pi  = 


k.= 


1- 


. \ 


1 


Yi 


V y 


(4 . 106) 


/^2  (r2)  =Po{^2+  p2e'^^‘*’^‘''’’} 


where  P2  = 


1+  ;CiiPi  + il  (1-  e'^‘^') 
11 


k. 

Y: 


K 

k,= 


1 + Ci  d-e'^'"’')  + J;li  (e’^^'^'-e'^''’-) 


Y2  = 


?i. 


1.V3 


(4 . 107) 
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^3(^3)  =Po(^3  + p3e''^'''’’'"’’} 


where  p,=  ^ 


1 + ^ ( 1 - e'^‘^‘)  + ^ ( 1 - e 


-lib. 


Yi 


Y: 


Y3 


1+  ii  d-e"’^^')  +£i^ d-e’’^’^')  +b^k2  + 


t; 


T 


P2 

~2 


Y3  ^1 


1- 


1 


V 


'FJC. 


(l_e-’^A) 


\ 


(4 . 108) 


g,2  (r, , r^)  =p 


0Y^12 


+ 


^1P2  _ Pi  ^-Y,(b,-r,) 


+ Pl2^ 


-X,(b,-r,)  ^iP 


1 


where  k,^- 


12 


^2-^1  ^1-^2 


(1-4-)  e 

"^3 


-Y2<^2-^2)  -Xj(b^-ri) 


X,k2 


p = n _ 1 ^ - ^2^1  4-  Pi 

P'3  t;'  t:e:  t: 


(4  d09) 


'3^2 


Pl3(d/  ^3)  =P 


Kp 


..  3 -7j(b,-r,)_  Pi  ^-y,(b,-r,) 

°^^'3  e 


+ Pl3e 


-Xj(b,-ri)  _|_  ^iP 


1 


"E 


where  k,^=  ■ ^1^3 


(1-  " ) e 

K2 


-Y3  (^3--f3)  -^2  (^1-A) 


13 


4- 


Pl3  ^ 


X,  A:,  1 A-,A:,  p, 

" 3 (1  _ -1  ) _ 3 1 Kl 

T-J  t;e;  ~2 


(4  dlO) 
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9^23  (r^,  r^)  =Po{k23+  (b^-r^)  +p23>e 


-Y2 


+ 


P22^^ 


-y^{bj-r,) 


where  k^^- 


1 

% 


^3P3  ^ ^lP2  ^ ^1P2  1 ^ 

^57  “7“  777  ^ ^ ^ 


+ 


X..P 


-Kh, 


^23=--^ 
■^3 

P12 


^ -^C  2 2 ^ 


j. — b^  (k-^2~^k^^)  + -—  (1  s 

-^2  ll 


i^3 


-X.b,  s Pl3  .-X,b, 


_ d-e'  ■ ■)  -dd  (l-e'"="‘) 


P23^ 


^2p2  _ 1 

^2  Y2 


^3P3  ^ ^lP2  ^ ^lP2  ^ 3 _ 1 3 ^3  _o-^3i>.^ 

-BT  ~tt  ^ ^ 


P23"~ 


^iP: 

b. 


1 + -^  (1--^)  d-e"^^'’') 
^2  ^2 


^12  (d)  =Po^^i2+  Pi2>e‘^’'^''^'’  + pj2.e'^'‘^'-^‘’} 


where  k.^^2- 


X^k, 


Pl2'“ 


Pl2"~ 


_ ^3Pl  ^2-^1 


^3^*2 


b. 


73(d)  =Po<73+  Pi3.e'^^‘'’‘'^'’  + pi3.e-^‘‘^--''-’} 


where  k^^- 


X^k, 


Pl3'~ 


^2Pl  '^2^1 


X77 
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b. 


(4  dll) 


(4  dl2) 


(4  dl3) 
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^23  (-^2)  =Po^^23  + P23-  + P23.  ( 1 "6 ) } 


where  = 


^^3-^12  ^2-^13  ^ 

- 


V 


y 


|b,+  ^a-e-'.‘.) 


^3pl^^  ^2pu^  ^ 

y"^7Yi~  ^2“ii  j 


^3"^2 

P^i‘=d5:^" 


Ck-,k, , , ^ 


~E~^  ~57~ 


j 


) 


+ -^  d-e'^’^')  + 


^^2  Pi  3^* 


V 


^3Pl  ^ 
^2“^3  Yl 


y 


P23' 


1 


r>C3P 


- Y; 


V 


7 A^i  p 1 A^i  p o 


1 ) d-e-^>*’') 

^3 


\ 


y 


*123  (d)  =Po- 


^^3*12^  ^2*12  ^ 

jb,  57~ 


V 


P12* 

(jb,  -r, ) (1  -e 


-Xj  (b,-r,) 


F 


) 


/ 


+ ^ (1  -e-^  ) + i.  ( ^3Pl2d^2Pd^  ( ^ (b.-r,,  ) 

Yl  *3  *2 


F 


rr  ( r-  >-  1 _ r-,  J ^1*22^  , ^3*12  ^ "^1^23  '^2^13  . , . > 

Pl23(d'd'  “ Po  1 — — 3-  ( J- + J- + J- ) (b>j  -Tj^  ) 


5^  F~  ~57 


-X,(b,-r,)j  Pl2‘  d _g-3-2(fci-r,)  ^ 

“57 


+ -^(l-e 

X 3 3 


+ XLi^i^fi^[P23,  a?2-d)  +p23.(l-e-^=‘^^'^^>)  ] 


^ 1 iPi2d  ^3pi  ^ /I  _p-r.<b.-^.)N 

Yi*2  Yi*2*3 


(4  dl4) 


(4  dl5) 


(4  dl6) 
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, , , 'k-,k 


2^M3  . (J3  r,)+^(l-e-^=‘^'-^'>) 


T. 


Pl2‘  ,,  ->.3(b,-r.)  ^ ^ ^ Pl2^^3  _ Pi^2 


■ X /I 

+ _^  (1-e 


4- 


XiP 

bji) 


2 g Ya  ^ ^3  ^1 ) 


1 


[ (jbi-rj)  + (1--^)  (1-e 


) ] 


(4 .117) 


^123  r^)  =p^\( 


^3-^12  , ^2-^13  , ^l-'^23 


4-_:_in- 


b-,  . i),  B 


) (jbj-rj)  +_^  (l-e'^‘^' 

■^2 


+ — (1  _^-r3(b.-r.)^  (jb^ 


b3 

Kp 


b^2 


b. 


-rb  r, 


1 


■*■  ^ ^2^  Q y 3 ^^3 


^2^  1 2 ^2_  ^~Y2^^2~-^2^  ^3^^1 

Tl 


+ 


^lP2 

t^e; 

^2  p7 

-T— ( -T~ +P232)  (-b^-e 

■^1  -^3 

^(|i.p„.)  (b,-e-''.'^-'.'r.)  . 


-Y2(^2-1'2) 


r,) 


(4 . 118) 
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Performance  measures 

The  performance  measures  for  the  M/U/1/3/3/1  model  can  be 
calculated  just  as  in  the  M/D/1/3/3/1  model.  The  14  subspaces 
for  the  M/D/1/3/3/1  model  as  outlined  in  Table  4.1  are  the 
same  14  subspaces  that  exist  in  the  M/U/1/3/3/1  model. 

The  probability  that  the  system  is  idle  can  be  calculated 
by  taking  the  inverse  of  the  sum  of  the  integrals  of  the 
density  functions  of  the  14  subspaces  over  all  values  of  the 
remaining  service  time. 

The  probability  that  the  server  is  idle  can  be  calculated 
by  the  normalizing  equation.  The  expected  duration  of  the 
idle  period  is  given  by 

^[Duration  of  Idle  Period]  = ^ (4.119) 

Ai  +A>2  '*■^3 

The  probability  that  either  the  1-job,  2-job  or  3-job  is  alone 
in  the  system  can  be  calculated  as 


P [ 1 -job  Alone] = 


P[2-job  Alone] = 


P[3-job  Alone] = 


r 


hj  ( ) drj  = p 


oY^i 


0 


b,  + ^ (1 
^ Yi 


h r 

(b,  (rj)  dr^=  Pojk 


2^2 


Y: 


r 


hj{r^)  dr^=  Pn/A:,b,+ 


0 


(4.120) 


(4 . 121) 


(4 . 122) 


The  probability  that  the  2-job  or  the  3-job  is  preempted  is 
given  by 
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P [X€  1 f 9i2  (r. , r,)  dr,  dr, 

0 0 


+ ^ ^9i23_(^if  ^2^  dr^dr^ 


(4.123) 


(4 . 124) 


The  probability  that  the  2-job  or  3-job  is  waiting  initially 
can  be  calculated  as 


P[XeWo‘^’ 


] = 


b, 

fh 

0 


12 


(r,) 


dr^  + 


h 


0 


123 


( ) dr. 


-b 


r^)  dr,dr^ 


P[Xe 


/hi„  (ri)  drj  + 

1 , r, ) dr^  dr. 


(4 . 125) 


(3 . 126) 


The  probability  that  the  2-job  is  in  Sv‘^’  is  given  by  adding 
the  probability  that  it  is  preempted  or  is  in  service.  This 
type  of  relationship  also  hold  true  for  the  probability  that 
the  3-job  is  in  . These  two  probabilities  can  be 


calculated  as  follows. 
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the  3- job  is  in  . These  two  probabilities  can  be 

calculated  as  follows. 


P[XeSy"’]=  P[XeP/<2)] +pfjs^g5(2)^ 


= P[Xe  ] + /hj  (r^)  drj+  //g23  (-^2'  -^3)  cfrjdr 


Tf 

0 0 


+ 


(4 . 127) 


P[XeS^^^]  = P[X€f7<3)]  + P[X€S<3>] 

= P[XeP7<^>]  + ihAr.)  dr, 

0 


(4 . 128) 


We  can  now  calculate  the  expected  values  of  the  2- job's  and  3- 
job's  cycle-times.  Since  the  cycle  time  is  made  up  of  the 
interarrival  time,  the  service  time,  the  in-process  waiting 
time  and  the  initial  waiting  time,  the  expected  values  can  be 
calculated  as 


1 

X 


+ + £[r„,„]  + £[r„,.] 


1 jb 

-^  + -^+P[X€W<2>]  Y<2)+P[X€Wo‘^’ ] 


Solving  this  equation  for  the  expected  value  of  we  obtain 


2 +X-,b 


P[  y(2)  j ^ JlXi^[l-  P[XeW<2)  ] - p[XeWo‘^’]'^ 


(4 . 129) 


The  expected  values  of  the  initial  waiting  time,  the  in- 
process  waiting  time  and  the  virtual  service  time  can  thus  be 


calculated  as 
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E[T^,„]=  P[XeP\^'2)j£;  1-^(2)]  (4.130) 

E[T„,.]  = P[X€P7o‘'’]E[y<2']  (4.131) 

E[r^,a,]  = £[r^,„] + B[r^,„]  = -^  + £[r„.,]  (4.132) 

Using  this  same  approach  for  the  3 — job,  the  expected 
values  of  the  cycle  time,  the  waiting  times  and  the  virtual 
service  time  can  be  written  as 


2 Jd 

£;[y(3)]^  _^.^^[l-P[X€iy<3>]  -P[XeP\^( 


(3) 


-1 


0 


E[T„,„]  = P[XePl7‘3)]£;[y(3)] 


= P[xePi^t5^’]  £;[y<3)] 


£[r^o,]=  E[T,,.,]+  E[T„,,,]=  ^+E[T„,„] 


(4.133) 

(4 . 134) 

(4 . 135) 

(4 . 136) 


Finally  the  virtual  arrival  rates  and  the  delay  factors 
for  the  2-job  and  the  3-job  can  be  calculated  as 


1 

/Iv  - 

F[  ] 


d<J>  = 


2 {E[T„„,]  +E[T^,„]  ) 


(4 . 137) 


(4 . 138) 


PC  System  Idle] 
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h1(r1)  k1 


Figure  4.1  State-Space  of  the  M/D/1/2/2/1  Model 


M/  □/  1/  2/  2/  1 Mode  I 


M 1-Job  Arr  I va  I Plate 

□ 12=0.05  + 12=0. 5 o 12=5. 0 


Figure  4.2  M/D/1/2/2/1  Model 

Probability  that  the  Server  is  Idle 


PC 2- Job  Alone]  ^ PC  1- Job  Alone] 


M/  0/  1/  2/  2/  1 Mode  I 

PC  Job  Alone]  vs.  M 


0 2 4 6 0 10 


11  : 1-Job  Arrival  Rate 

□ 12=0. 05  + 12=0. 5 o 12=5. 0 


igure  4 . 3 


M/D/1/2/2/1  Model  Probability  that  the 
1-Job  is  Alone  in  the  System 


M/  □/  1/  2/  2/  1 Mode  I 


II  1-Job  Arrival  Rate 

□ 12=0. 05  + 12=0. 5 o 12=5. Q 


Figure  4.4  M/D/1/2/2/1  Probability  that  the 

2-Job  is  Alone  in  the  System 


PCX  in  SVC2DD  PCX  in  WC2]): 
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M/  □/  1/  2/  2/  1 Mode 


11  1-Job  Arrival  Rate 

□ I2=Q.Q5  + 12=0.5  o 12=5. 0 


gure  4 . 5 


M/D/1/2/2/1  Model  Probability  that  the 


2-Job  is  Preempted 
M/  D/  1/  2/  2/  1 Mode  I 

PCX  In  SvC2D]  vs . II 
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0. 1 
0 

° 2 4 6 8 10 

II  1-Job  Arr I va I Rate 

□ 12=0. 05  4-  12=0. 5 o 12=5. 0 


Figure  4.6  M/D/1/2/2/1  Model  Probability  that  the 

2-Job  has  Received  Partial  Service 
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M/  D/  1/  2/  2/  1 Mode 


PCX  J n woe 2:)]  vs  . M 


11  1-Job  Arrival  Rate 

□ 12=0.05  + 12=0. 5 o 12=5. 0 


Figure  4.7  M/D/1/2/2/1  Model  Probability  that  the  2-Job 

has  Arrived  but  Not  Received  Service 

M/D/1/2/2/1  Model 


PC  2- Job  Virtual  Arrival  Plate]  vs.  11 


II  ; 1-Job  Arrival  Rate 

□ 12=0. 05  + 12=0. 5 O 12=5. 0 


Figure  4.8  M/D/1/2/2/1  Model  2-Job  Virtual  Arrival  Rate 


150 


M/ 0/1/ 2/ 2/1  Mode 


f^2-Job  Completion  Time]  vs.  M 


□ I2  = 0.05 


M ; 1-Job  Arrival  Rate 
+ I2  = 0.5 


O I2  = 5.0 


Figure  4.9  M/D/1/2/2/1  Model  2-Job  Expected  Completion  Time 


r~i 

V- 

O 

•M 

O 

d 

u. 

> 

C] 

« 

Q 

n 

0 

1 

OJ 

h! 


M/  □/  1/  2/  2/  1 Mode  I 


0 2 ^ 6 8 10 

II  1-Job  Arr I va I Rate 

□ 12=0. 05  + 12=0. 5 o 12=5.0 


Figure  4.10  M/D/1/2/2/1  Model  2-Job  Delay  Factor 


PC  1- Job  Alone]  PC  System  Idle] 
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M/D/  1/3/3/  1 Model 


PC  System  Idle]  vs.  11 


II  1-Job  Virtual  Arrival  Rate 

□ I2  = Q.0Q5  + 12=0.05  O 12=0. 5 

Figure  4.11  M/D/1/3/3/1  Model 

Probability  that  the  Server  is  Idle 


M/D/1/3/3/  1 Model 


0 2 A 6 B 10 

11  • 1-Job  Virtual  Arr I va I Rate 

□ 12  = 0.005  + 12=0.05  O 12=0. 5 

Figure  4.12  M/D/1/3/3/1  Model  Probability 

that  the  1-Job  is  Alone  in  the  System 


PC 3- Job  Alone]  PC 2- Job  Alone] 
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M/D/1/3/3/1  Mode 


PC 2- Job  Alone]  vs.  11 


11  * 1-Job  Virtual  Arrival  Rate 

□ I2  = 0.005  + 12=0.05  O 12=0. 5 

Figure  4.13  M/D/1/3/3/1  Model  Probability 

that  the  2-Job  is  Alone  in  the  System 


M/D/1/3/3/1  Model 


PC  3- Job  Alone]  vs.  II 


11  • 1-Job  Virtual  Arrival  Rate 

□ I2  = 0.005  12  = 0.05  O 12  = 0. 5 


Figure  4.14  M/D/1/3/3/1  Model  Probability 

that  the  3-Job  is  Alone  in  the  System 


PCX  In  WC 3!)]  PCX  In  WC2D: 
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M/  D/  1/  3/  3/  1 Mode  I 


PCX  In  v6.  M 


M • i-Job  Virtual  Arrival  Rate 

□ I2  = 0.005  12  = 0.05  O 12  = 0. 5 


Figure 


4.15  M/D/1/3/3/1  Model  Probability 

that  the  2-Job  is  Preempted 


M/D/'1/3/3/1  Model 


PCX  In  K3D3  VC,  M 


11  1-Job  Virtual  Arr  I va  I Rate 

□ I2  = 0.005  + 12=0.05  O 12=0. 5 


Figure  4.16  M/D/1/3/3/1  Model  Probability 

that  the  3-Job  is  Preempted 


PCX  In  SvC3D:  ''  PCX  in  SvC2D: 


M/D/1/3/3/1  Model 


PCX  In  SVC2DD  vs.  M 


M • 1-Job  Virtual  Arrival  Rate 

□ I2  = 0.005  + 12=0.05  O 12=0. 5 


Figure 
hat  the 


4 . 17 
2-Job 


M/D/1/3/3/1  Model  Probability 
is  either  Preempted  or  in  Service 


M/  D/  1/  3/  3/  1 Mode  I 


PCX  In  SVC3DD  vs.  11 


(1  • 1-Job  Virtual  Arrival  Rate 

□ 12  = 0.005  -t  12=0. 05  O 12  = 0. 5 


Figure  4.18  M/D/1/3/3/1  Model  Probability 

that  the  3-Job  is  either  Preempted  or  in  Service 
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M/  D/  1/  3/  3/  1 Mode  I 


Figure  4.19  M/D/1/3/3/1  Model 

that  the  2-Job  has  Arrived  but  not 


Probability 
Received  Service 


M/D/1/3/3/  1 Model 


PCX  in  WQ3] 


M - 1-Job  Arrival  Rate 

a 12  = 0.005  + 12=0.05  O 12=0. 5 


Figure  4.20  M/D/1/3/3/1  Model  Probability 

that  the  3-Job  has  Arrived  but  not  Received  Service 


3-Job  Expected  Virtual  Arrival  Rate  2-Job  Expected  Virtual  Arrival  Rate 
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M/D/1/3/3/1  Model 


2- Job  Expected  Virtual  Arrival  Rate 


M - 1-Job  Arrival  Rate 

□ I2  = 0.005  + 12=0,05  O 12=0. 5 


Figure  4.21  M/D/1/3/3/1  Model  2-Job 

Expected  Virtual  Arrival  Rate 


M/D/1/3/3/1  Model- 


3- Job  Expected  Virtual  Arrival  Rate 


11  - 1-Job  Arrival  Plate 

(2  = 0.005  + 12=0. 05  O 12=0. 5 

Figure  4.22  M/D/1/3/3/1  Model  3-Job 

Expected  Virtual  Arrival  Rate 
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2- Job  Expected  Completion  Time 


□ I2  = 0.005 


i - 1-Job  Arrival  Rate 
+ I2  = 0.05 


I2  = 0.5 


Figure  4.23  M/D/1/3/3/1  Model  2-Job  Expected  Completion  Time 


M/.D/ 1/.3/3/ 1 Model 


3- Job  Expected  Completion  Time 


M - 1-Job  Arrival  Rate 

O 12  = 0.005  + 12=0. 05  O 12=0. 5 


Figure  4.24  M/D/1/3/3/1  Model  3-Job  Expected  Completion  Time 


I- Job  Delay  Factor  i_i.  2- Job  Delay  Factor 


W D/  1/  3/  3/  1 Mode  I 


2- Job  Delay  Factor 


M - 1-Job  Arrival  Rate 

□ I2  = 0.005  + 12=0.05  O 12=0. 5 

gure  4.25  M/D/1/3/3/1  Model  2-Job  Delay  Factor 

M/D/1/3/3/1  Model 


3- Job  Delay  Factor 


11  - 1-Job  Arrival  Rate 

□ 12  = 0.005  + 12=0. 05  O 12=0. 5 


Figure  4.26  M/D/1/3/3/1  Model  3-Job  Delay  Factor 


PC  1“  Job  Alone]  PC  System  Idle] 
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M/U/  1/2/2/  1 Mode  I 


PC  System  Idle]  vs.  11 


M 1-Job  Expected  Arrival  Rate 

□ I2  = 0.05  + I2  = 0.5  O I2  = 5.0 


Figure  4,27  M/U/1/2/2/1  Model 

Probability  that  the  Server  is  Idle 


M/  U/  1/  2/  2/  1 Mode  I 


0 2 A 6 8 10 


II  • 1-Job  Expected  Arrival  Rate 

□ 12=0. 05  + 12=0. 5 O 12=5. 0 

Figure  4.28  M/U/1/2/2/1  Model  Probability 

that  the  1-Job  is  Alone  in  the  System 


PCX  In  WC2DD  PC 2- Job  Alone] 
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M/  U/  1/  2/  2/  1 Mode  I 


PC 2- Job  Alone]  vs.  11 


II  • 1-Job  Expected  Arrival  Rate 

□ 12=0,05  + 12=0. 5 O 12=5. 0 


Figure  4.29  M/U/1/2/2/1  Model  Probability 

that  the  2-Job  is  Alone  in  the  System 


M/U/1/2/2/1  Model 


PCX  In  K2]]  vs.  II 


11  1-Job  Expected  Arr  I va  I Plate 

□ 12=0. 05  + 12=0. 5 O 12=5. 0 


Figure  4.30  M/U/1/2/2/1  Model  Probability 

that  the  2-Job  is  Preempted 
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M/U/1/2/2/1  Model 


PCX  in  SVC2DD  vs.  M 


M • i-Job  Expected  Arrival  Plate 

□ 12=0.05  + 12=0. 5 O 12=5. 0 


Figure  4.31  M/U/1/2/2/1  Model  Probability 

that  the  2-Job  is  either  Preempted  or  in  Service 


M/U/1/2/2/4  Model 


M • i-Job  Expected  Arr I va I Rate 

□ 12=0.05  + 12=0. 5 O 12=5.0 


Figure  4.32  M/U/1/2/2/1  Model  Probability 

that  the  2-Job  has  Arrived  but  not  Received  Service 


EC 2-Job  Completion  TIrr«]  ^2-Job  Virtual  Arrival  Rato] 
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M/  U/  1/  2/  2/  1 Mode  I 


0;2-Job  Virtual  Arrival  Rate]  vs.  11 


11  • 1-Job  Expected  Arr I va  I Rate 

□ 12=0. 05  + 12=0. 5 O 12=5. 0 

Figure  4.33  M/U/1/2/2/1  Model 

2-Job  Expected  Virtual  Arrival  Rate 


M/U/1/2/2/1  Model 


^ 2- Job  Completion  Time]  vc . II 


11  • 1-Job  Expected  Arr I va I Rate 

□ 12=0. 05  + 12=0. 5 O 12=5.0 


Figure  4.34  M/U/1/2/2/1  Model  Expected  2-Job  Completion  Time 
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M/U/  1/2/2/  1 Model 


M • 1-Job  Exp>ected  Arr  I va  I Rate 

□ I2=G.05  + 12=0.5  o 12=5. 0 


Figure  4.35  M/U/1/2/2/1  Model  2-Job  Delay  Factor 


CHAPTER  5 
MARKOV  MODELS 

Introduction 

In  the  past  chapters  we  have  analyzed  basic  preemptive 
priority  models.  In  Chapter  3,  Markov  models  were  used  to 
evaluate  the  performance  measures  for  basic  preemptive  resume 
systems.  In  this  chapter  we  will  analyze  two  variations  on 
this  basic  system.  First,  we  will  assume  that  there  is  a 
penalty  for  preemption.  Figure  1.6  shows  a diagram  of  this 
system.  Then  we  will  look  at  a system  that  allow  jobs  to 
switch  priorities  when  they  arrive  at  the  queue.  Figure  1.7 
shows  a diagram  of  this  system. 

We  will  assume  that  the  service-time  and  interarrival- 
time distributions  are  exponential.  These  assumptions  allow 
us  to  use  Markov  models  to  represent  the  systems  under 
analysis . 


Systems  with  Penalties 

Model 

All  of  the  basic  models  have  assumed  that  preempted  jobs 
are  resumed  with  the  required  service  time  being  the  service 
time  remaining  when  it  was  preempted.  In  most  applications 
however,  there  is  some  penalty  for  preempting  a job.  This 
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penalty  is  usually  assessed  to  the  low  priority  job  when  it 
resumes  service  after  a preemption.  An  analogy  to  this  would 
be  setup  costs  involved  in  a manufacturing  task.  If  that  task 
has  to  be  stopped  for  any  reason  and  restarted,  when  it 
restarts,  there  may  be  a added  cost  of  getting  it  restarted, 
similar  to  the  cost  of  its  initial  setup.  Another  system  that 
can  be  represented  by  this  model  is  that  of  a person  assigned 
to  a number  of  tasks  that  could  arrive  at  any  time;  for 
example  a receptionist'  that  also  has  some  typing  duties  to 
perform.  The  penalty  for  preempting  their  typing  and 
attending  to  a someone  walking  up  to  their  station  is  the 
reorientation  time  needed  when  they  return  to  their  typing. 

Markov  models  of  this  seem  to  be  an  acceptable  approach 
for  these  systems  when  the  service  times  are  exponential. 
Figure  5.1  shows  a sample  realization  of  such  a system.  Since 
the  penalty-time  distribution  varies  from  system  to  system,  we 
have  decided  to  use  a n-stage  Erlang  distribution  with 
parameter  for  stage  j.  This  allows  the  analyst  to  set  the 
value  of  n and  thus  control  the  coefficient  of  variation  of 
the  penalty-time  distribution.  For  the  purpose  of  this 
analysis  we  will  assume  all  y^s  are  set  equal  to  y. 

For  the  2-class  case  there  are  a total  of  n+5  states;  one 
when  the  system  is  idle,  one  when  the  1-job  is  alone  in  the 
system,  one  when  the  2-job  is  alone  in  the  system,  one  when 
the  2-job  is  waiting  without  having  started  service  (initial 
waiting)  , one  when  the  2-job  is  preempted  and  n for  the  n- 
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stage  penalty.  From  now  on  the  n stages  of  the  penalty  will 
be  referred  to  as  the  n setup  stages. 


Performance  Measures 

The  first  step  in  the  analysis  of  this  system  is  the 
solution  of  the  steady-state  probabilities.  These 
probabilities  can  be  written  as 
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The  next  step  is  the  calculation  of  the  expected,  first 
passage  times.  Let  tg  be  the  expected  first  passage  time  from 
the  state  in  which  the  2-job  is  preempted  to  the  state  in 
which  the  2-job  resumes  service  (after  the  penalty  period  is 


passed) , and  similarly  let  t^, 


for  i from  1 to  n,  be  the 
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expected  first  passage  time  from  the  state  corresponding  to 
the  i-th  setup  stage  to  the  state  in  which  the  2-job  is 
served.  These  expected  first  passage  times  can  be  written  as 
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Therefore  the  expected  virtual  service  time,  E[TSv*^*]^  is  the 
expected  first  passage  time  from  the  state  2 to  state  0/  that 
is  from  the  state  where  the  2-job  first  starts  service  to  the 
state  where  the  2-job  is  completed.  This  period  includes  in- 
process  waiting  time  due  to  preemption  by  higher  priority  jobs 
and  can  be  written  as 


where  p = — 

JTTi 
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1-p 
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(1-p)  (y+Aj) 


(5.9) 


The  expected  in-process  waiting  time  and  the  expected 


initial  waiting  time  can  be  calculated  as 


E[T^,.,]=  E[T^..,]- ^ (5.10) 

£[r„,.,]  = (5.11) 

The  expected  completion  time,  the  expected  cycle  time, 
the  virtual  arrival  rate  and  the  delay  factor  of  the  2-job  are 
given  by 
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E[Tc-]  = E[T„.,]  + E[T^y,] 

(5.12) 

B[Y<^>]=  E[T^..] 

(5.13) 

7 (2)  _ 1 

(5.14) 

d<2>=  (E[T^..,]  + E[T^..]  )a, 

(5.15) 

The  probabilities  of  the  system  being  in  different  states 
can  now  be  calculated  as 


P[ Server  Idle] = n 
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Systems  with  Switching  Priorities 

Model 

The  last  system  that  we  will  address  is  one  in  which  the 
priority  of  the  jobs  in  the  system  are  reassigned  upon  the 
arrival  of  each  new  job  to  the  system.  An  example  of  this  is 
the  case  where  interrupts  from  hardware  and  software  are 
handled  by  the  central  processor.  When  each  job  arrives  to 
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the  queue,  it  sets  a flag  based  on  its  urgency.  The  job  may 
or  may  not  have  a priority  ranking  before  it  arrives  to  the 
queue,  however,  based  on  the  urgency  flag,  that  priority  may 
be  increased  and  allow  it  to  preempt  the  job  that  is  being 
served  when  it  arrives.  Figure  5.2  shows  a sample  realization 
of  such  a system  with  2 priority  classes. 

An  example  of  such  a system  is  a computer  network  with 
one  central  server  to  which  all  jobs  are  submitted.  Suppose 
there  are  n substations  from  which  jobs  can  be  submitted,  each 
substation  being  able  to  submit  one  of  m job  types.  For 
example,  a substation  may  initiate  a print  request  or  a 
directory  search  or  a file  save  request.  It  is  known  that 
each  substation  may  have  only  one  job  request  outstanding  at 
any  given  time;  that  is,  substation  j will  not  initiate  a new 
job  until  its  current  request  is  completed.  This  means,  as 
far  as  the  central  processor  is  concerned,  there  is  a maximum 
of  n jobs  possible  in  the  system  at  any  time,  a maximum  of  one 
from  each  substation. 

■ The  main  difference  between  this  model  and  the  basic 
M/M/l/n/n/1  model  is  that  the  arrival  rate  for  any  given  j-job 
is  modified  by  multiplying  it  with  a probability  mass  Pj^^.  The 
decision  making  system  that  allows  the  determination  of  the 
new  priority  is  apriori  probability  masses  p^^  that  gives  the 
probability  that  an  arriving  i-job  will  have  priority  j. 

This  system  can  be  captured  in  a Markov  model  when  it  can 
be  assume  that  the  service  times  are  exponentially 
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distributed.  The  model  with  2 priority  classes  have  5 states. 


Performance  Measures 

If  we  define  P12A.1  as  the  arrival  rate  of  the  1-job  which 
will  have  a lower  priority  than  the  2- job  when  it  arrives. 
Similarly,  P2A2  is  the  arrival  rate  of  the  2-job  which  will 
have  a higher  priority  than  the  1-job  when  it  arrives.  Also, 
P11A.1  and  P22^2  sre  the  arrival  rates  of  the  1-job  and  the  2-job 
that  maintain  their  original  priorities  as  in  the  basic  model 
when  they  arrive. 

The  analysis  of  this  model  is  carried  out  just  as  in  the 
previous  model.  First  the  steady  state  probabilities  must  be 
evaluated.  Then  the  expected  first  passage  times  are 
calculated . 

The  2-job  expected  virtual  service  time  is  calculated  as 


£[T„,.]  = 


OCip22^2 

a^tt2  + 0C^Pi2^l  ^2^22^: 


a. 


a. 


(5.22) 


2^12^1  ( 1 jp21^2  ^^^2  ^ jPl2^1-P22^2 

(ai+P22^2)  (OCi-^^2)  (^i“^P22^2) 


All  other  performance  measures  are  calculated  using 


traditional  approaches  to  Markov  model  analysis. 
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Figure  5.1  Sample  Realization  of  the  Model  with  Penalties 


Figure  5.2  Sample  Realization  of  Models 

with  Switching  Priorities 


CHAPTER  6 
SUMMARY 


Introduction 

In  this  dissertation,  we  introduce  and  analyze  models  of 
a preemptive  priority  queueing  system  that  is  motivated  by 
microprocessor  control  systems.  The  models  analyzed  are 
unique  in  the  fact  that  all  of  the  priority  classes  have  only 
one  job  each.  We  present  results  for  models  with  exponential 
interarrival  time  distributions  and  service  time  distributions 
that  are  general,  deterministic,  and  exponential.  Closed  form 
expressions  are  given  for  all  of  the  discussed  performance 
measures  of  these  models.  In  this  chapter,  we  will  summarize 
the  results  obtained  for  the  different  models  and  discuss  some 


areas  of  future  research  related  to  this  work. 


Results 

In  Chapter  3 basic  preemptive-resume  models  with 
unbounded  service  time  distributions  were  analyzed.  Also,  in 
Chapter  4 basic  preemptive-resume  models  with  bounded  service 
time  distributions  were  analyzed.  Table  6.1  show  the  values 
of  the  parameters  for  the  interarrival  time  distributions  and 
the  service  time  distributions  that  are  used  to  graph  the 
performance  measures. 
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Firstly,  comparing  the  discrete-time  model  and  the 
continuous-time  model,  as  expected  the  performance  curves  look 
similar.  This  was  expected  because  the  discrete-time  model  is 
an  approximation  of  the  continuous-time  model. 


Table  6 . 1 Parameter  Values  for  Performance  Measures 


MODEL 

Interarrival  Time 

Service  Time 

M/M/1/2/2/1 

tti  = tt2  = 0 . 5 

0 < ^1,  ^2  50 

M/M/1/3/3/1 

tti  = tt2  = OC3  = 0.5 

0 < , ^2^50,  ^3  = 0.5 

M/D/1/2/2/1 

kj  = k2  = 2.0 

0 < ^1,  ^2  ^ 50 

M/D/1/3/3/1 

0 

• 

Csl 

II 

II 

(NJ 

II 

rH 

0 < ^2  ^ 50,  X3  = 0 . 5 

M/U/1/2/2/1 

0 

• 

II 

CNJ 

II 

0 < ^1,  A.2  < 50 

Secondly,  comparing  the  M/M/1/2/2/1  model  to  the 
M/D/1/2/2/1  model  the  following  is  noted. 

1.  The  probability  that  the  systems  being  idle  drops 
off  at  a faster  rate  for  the  M/M/1/2/2/1  model. 

2.  The  probability  that  the  1-job  is  alone  in  the 
system  reaches  a maximum  faster  with  the 
M/M/1/2/2/1  model. 

3.  The  2- job  is  more  likely  to  be  preempted  in  the 
M/M/1/2/2/1  model. 

4 . The  2-job  is  less  likely  to  be  in  initial  waiting 
in  the  M/M/1/2/2/1  model. 

5.  The  2- job  virtual  arrival  rate,  is  lower  in 

the  M/M/1/2/2/1  model. 
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6.  The  2- job  expected  cycle  time  and  the  expected 
completion  time  are  both  larger  in  the  M/M/1/2/2/1 
model . 

7.  The  2- job  delay  factor,  d‘^’,  is  larger  in  the 
M/M/1/2/2/1  model. 

All  of  these  observations  can  be  explained  for  the  fact 
that  the  expected  interarrival  times  of  the  M/M/1/2/2/1  model 
is  unbounded  whereas  those  in  the  M/D/1/2/2/1  model  is 
bounded.  The  unbounded  service  time  distribution  means  that 
any  arrival  may  have  a service  time  ranging  from  0 to  infinity 
and  so  the  variance  is  larger  than  in  the  M/D/1/2/2/1  model. 

Thirdly,  comparing  the  M/U/1/3/3/1  model  to  the 

M/D/1/2/2/1  model  the  observations  are  similar  to  the 
comparison  of  the  M/M/1/2/2/1  model  and  the  M/D/1/2/2/1  model. 
Again,  this  can  be  explained  by  noting  that  the  variance  of 
the  service  times  in  the  M/U/1/2/2/1  model  is  larger  than  in 
the  M/D/1/2/2/1  model. 

Finally,  comparing  the  M/M/1/3/3/1  model  and  the 

M/D/1/3/3/1  model,  the  observations  are  similar  to  those  in 
the  comparison  of  the  M/M/1/2/2/1  and  the  M/D/1/2/2/1  model 
except  that  the  response  of  the  performance  measures  of  the  3- 
job  are  more  extreme  than  that  of  the  2- job.  These  are  seen 
more  clearly  in  Figures  4.13  to  4.26. 
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Future  Work 

Two  areas  of  future  work  are  on  the  develop  of  useable 
design  guidelines  and  on  the  analysis  of  models  with  more 
uniform  [a,b]  service  time  distributions. 

System  Design  Guidelines 

There  is  a need  for  future  work  in  the  area  of  developing 
guidelines  for  system  designers  to  transfer  the  results  of 
this  work  into  useable  tools. 

For  example,  the  maximum  loading  of  the  system  should  be 
determined  for  many  more  ranges  of  values  than  was  done  for 
this  work.  Another  example  might  be  the  use  of  the 
probability  of  lowest  priority  job  being  in  initial  waiting. 
This  is  important  information  for  designers  of  systems  that 
have  jobs  that  have  a critical  need  for  being  admitted  into 
service  without  emphasis  on  actually  completing  service,  such 
as  in  food  processing. 

Designers  of  other  systems  may  be  interested  in  the 
expected  completion  time  or  the  virtual  arrival  rate  of  the 
lowest  priority  job.  This  may  be  important  information  for 
jobs  that  need  to  be  in  and  out  of  the  system  as  fast  as 
possible . 

Further  work  may  help  develop  useable  guidelines  that 
will  allow  designers  to  evaluate  possible  designs. 
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Uniformly  fa,b1  Distributed  Service  Times 

Models  with  uniformly  distributed  service  times  are 
discussed  in  Chapter  4.  These  models  assume  the  service  time 
for  the  i-job  is  distributed  [0,bi].  Slightly  more  realistic 
and  complicated  models  are  service  time  distributions  that  are 
uniformly  distributed  [a^,  bj^]  . 

The  added  complexity  of  these  models  arise  from  the  fact 
that  the  state  space  is  now  separated  into  many  more  regions. 
For  example,  for  the  2 class  model,  the  state  space  in  which 
both  jobs  are  present  can  now  be  separated  into  4 regions 
which  are  defined  by  the  boundaries  of  the  service-time 
distribution  and  the  axes. 

Figure  6.1  shows  the  state  space  for  a model  with  2 
priority  classes,  each  with  service  times  that  are  distributed 
uniform  [a^,  b^]  . 


Conclusion 

As  mentioned  previously,  each  model  analyzed  in  this 
dissertation  is  unique  in  the  fact  that  all  of  the  priority 
classes  have  only  one  job  each.  This,  combined  with  the 
nontradit ional  approaches  used  to  solve  the  equations 
representing  the  density  functions  of  the  remaining  service 
times  of  the  jobs  in  the  system,  make  this  work  a new 
development  in  the  analysis  of  preemptive  priority  queues. 
Also,  the  performance  measures  that  were  obtained  are 
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different  to  those  that  are  traditionally  used,  and  are  more 
practical  for  the  purposes  of  this  analysis. 

The  models  outlined  for  future  research  are 
mathematically  challenging  problems,  and  at  the  same  time, 
based  on  real  life  applications.  The  solution  of  these  models 
will  provide  further  insight  into  the  behavior  of  the  systems 
they  represent . 


Figure  6.1  State  Space  of  the  M/U/1/2/2/1  [a^,  b^]  Model 


APPENDIX 

SOLUTION  OF  LINEAR  DIFFERENTIAL  EQUATIONS 


Assume  that  the  differential  equations  will  be  of  the 
following  form  : 


df{x)  , V 

^ — - = Af  (x)  - Be 

dx 


(A.l) 


Solution  I . Let 

f (x)  = (A.  2) 

Differentiating  and  substituting  A. 2 into  A.l  gives; 

dx  dx 

= A[Qe'’^]  - Be-“^ 
dx 


Thus, 


dx 


0-  {A+a.)  X 


So 


B 

A+a 


The  general  solution  for  f (x) , for  differential  equations 
of  the  form  given  in  equation  A.l  is  therefore 
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B 


f {x)  = e 

A+a 


Solution  II . The  integrating  factor  for  equation  A.l  is: 


I(x)  = e 


- (acLx 

- J — 


-Ax 


Mutilplying  by  I (x)  on  both  sides  of  A.l  and  reorganizing,  we 
have 


g.Ax  df{X)  _ ^ _jgg-(A*a)x 

ox 


dx^  ■' 


Integrating  both  sides  of  this  equation  and  solving  for  f (x) 
gives 


f (x)  = __^e-‘“+ 
A+a 
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